00010000:00000010:0.1F:1781280683.416677:0:0:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 00000000b6b92f5b. 00010000:00000010:0.1:1781280683.416704:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 00000000cb88f684. 00010000:00000010:1.1F:1781280684.203354:0:0:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 00000000f8db1abb. 00010000:00000010:1.1:1781280684.203386:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 0000000065b918e4. 00010000:00000010:2.1F:1781280684.211989:0:6137:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 00000000eab94067. 00010000:00000010:2.1:1781280684.212026:0:6137:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 000000003b89e9e4. 00010000:00000010:2.1:1781280684.212031:0:6137:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 00000000afc6cb82. 00010000:00010000:0.0:1781281092.578371:0:8297:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.578377:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.578420:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x3ae:0x0]: returning size 4096 00000004:00200000:0.0:1781281092.578424:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.578444:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.578455:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.578479:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd20a06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a56c expref: 652 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.578490:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a56c expref: 651 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.578507:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ae:0x0].0x0 (000000007f54b4c0) 00010000:00010000:0.0:1781281092.578510:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.578512:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000af240689, rc 0) 00000100:00100000:0.0:1781281092.578562:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085223d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+651:12455:x1867808064724032:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 7485us (12549us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.578570:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16161 00000100:00100000:0.0:1781281092.580935:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064724224 00000100:00100000:0.0:1781281092.580997:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16162 00000100:00100000:0.0:1781281092.581003:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6e19c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+651:12456:x1867808064724224:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.581028:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.581050:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20a1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a573 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.581109:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.581125:0:8297:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd209ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a565 expref: 652 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.581132:0:8297:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.581166:0:8297:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd209ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a565 expref: 652 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.581179:0:8297:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd209ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a565 expref: 652 pid: 6158 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.581191:0:8297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc1b8f82 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083774528:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.581273:0:8297:0:(client.c:2500:ptlrpc_set_wait()) set 0000000031bf789d going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.585449:0:8297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc1b8f82 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083774528:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.585476:0:8297:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.589590:0:8297:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.589599:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.589645:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x3ad:0x0]: returning size 57088 00000004:00200000:0.0:1781281092.589649:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.589668:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.589679:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.589706:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20a1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a573 expref: 653 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.589719:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a573 expref: 652 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.590487:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (00000000443c972a) 00010000:00010000:0.0:1781281092.590490:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.590493:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d874006, rc 0) 00000100:00100000:0.0:1781281092.590713:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6e19c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+652:12456:x1867808064724224:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 9708us (11220us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.590729:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16162 00000100:00100000:0.0:1781281092.596600:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064724544 00000100:00100000:0.0:1781281092.596647:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16163 00000100:00100000:0.0:1781281092.596653:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bca97f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+652:12455:x1867808064724544:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281092.596702:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1781281092.596929:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd20a0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a56c expref: 652 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.596959:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3ae:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4e7 expref: 651 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.596970:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ae:0x0].0x0 (000000007f54b4c0) 00010000:00010000:0.0:1781281092.596978:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281092.597007:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597021:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597029:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597045:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x51683c58 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597051:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51683c58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597056:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51683c58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597146:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20a37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597153:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20a37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.597163:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20a37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281092.598083:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].384, 64 off32896 00000004:00080000:0.0:1781281092.598090:0:8297:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 615302547658ns, next at 616302545406ns, rc = 0 00000040:00080000:0.0:1781281092.598109:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4909, 184 off861704 00010000:00010000:0.0:1781281092.598177:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598189:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598198:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598206:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598283:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598402:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20a3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598472:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281092.598491:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bca97f4a reply state 0000000005fdfacb transno 4294975364 ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20a37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598578:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598585:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598592:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598598:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007b3586af already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.598601:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598607:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598617:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281092.598619:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.598622:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.598627:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20a29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281092.598635:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bca97f4a reply state 0000000005fdfacb transno 4294975364 ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51683c58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281092.598738:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bca97f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+652:12455:x1867808064724544:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2082us (3073us total) trans 4294975364 rc 0/0 00000100:00100000:0.0:1781281092.598748:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16163 00000100:00100000:0.0:1781281092.602252:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281092.605183:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281092.605186:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281092.605188:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281092.610908:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.610998:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.615343:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16165 00000100:00100000:0.0:1781281092.615356:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7fad30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+655:12456:x1867808064724864:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.615390:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.615417:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20a53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a581 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615487:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615512:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615533:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615585:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615604:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615611:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615683:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615692:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615699:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615705:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ff7f832d already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.615708:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615715:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615739:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.615741:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.615746:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615751:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20a5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615761:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615767:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615772:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615782:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000150e198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.615784:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615790:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615797:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x1e68dc46 (0000000069107448) 00010000:00010000:0.0:1781281092.615800:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.615802:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615808:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615840:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20a53 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a581 expref: 656 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615848:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20a53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a581 expref: 656 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.615856:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004eec315, rc 0) 00000100:00100000:0.0:1781281092.615929:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7fad30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+655:12456:x1867808064724864:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 574us (4931us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.615937:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16165 00000100:00100000:0.0:1781281092.621164:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.621233:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.621268:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064725056 00000100:00100000:0.0:1781281092.621330:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16166 00000100:00100000:0.0:1781281092.621337:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002be707e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+655:12456:x1867808064725056:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281092.621393:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1781281092.621418:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20a22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a573 expref: 655 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621437:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd207dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3ad:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4af expref: 654 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621446:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (00000000443c972a) 00010000:00010000:0.0:1781281092.621454:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd209a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a550 expref: 653 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621461:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.621464:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281092.621486:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621509:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621517:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621561:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20a6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621569:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621576:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621911:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20a76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0xecff8659 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621921:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20a76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xecff8659 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.621927:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20a76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xecff8659 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.622054:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20a7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.622064:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20a7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.622070:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20a7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281092.624317:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4911, 224 off862096 00000004:00010000:0.0:1781281092.624425:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002be707e9 reply state 00000000b0965033 transno 4294975366 ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20a7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624443:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624449:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624456:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624462:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c8f5194 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.624466:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624473:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624486:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.624489:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.624493:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.624906:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20a68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281092.624921:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002be707e9 reply state 00000000b0965033 transno 4294975366 ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281092.624928:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002be707e9 reply state 00000000b0965033 transno 4294975366 ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20a76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xecff8659 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281092.625067:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002be707e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+654:12456:x1867808064725056:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 3727us (3832us total) trans 4294975366 rc 0/0 00000100:00100000:0.0:1781281092.625076:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16166 00000100:00100000:0.0:1781281092.630967:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.634215:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.638972:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.639011:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.640994:0:6157:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c731fb2 going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.651653:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.651735:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281092.653854:0:6157:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.653862:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.653881:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x3ad:0x0]: returning size 57088 00010000:00010000:0.0:1781281092.654014:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20ab5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a596 expref: 658 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.654028:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a596 expref: 657 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.654035:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (00000000443c972a) 00010000:00010000:0.0:1781281092.654037:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1781281092.654039:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea9f0d27, rc 0) 00000100:00100000:0.0:1781281092.654092:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b24225e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+657:12456:x1867808064725376:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 13661us (15080us total) trans 4294975368 rc 0/0 00000100:00100000:0.0:1781281092.654101:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16169 00000100:00100000:0.0:1781281092.656188:0:6158:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f27253a pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083774784:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.656217:0:6158:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281092.656964:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.657027:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281092.657578:0:6158:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657586:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.657613:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x267:0x0]: returning size 1048576 00010000:00010000:0.0:1781281092.657757:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd20ac3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a59d expref: 657 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657771:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a59d expref: 656 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657778:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x267:0x0].0x0 (0000000062e104fb) 00010000:00010000:0.0:1781281092.657780:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1781281092.657783:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cbdb2393, rc 0) 00000100:00100000:0.0:1781281092.657823:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf8514d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+656:12455:x1867808064725504:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 6005us (6179us total) trans 4294975369 rc 0/0 00000100:00100000:0.0:1781281092.657830:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16170 00000100:00100000:0.0:1781281092.657848:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064725696 00000100:00100000:0.0:1781281092.657868:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16171 00000100:00100000:0.0:1781281092.657871:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f65a123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+656:12456:x1867808064725696:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.657886:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.657897:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20adf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5a4 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657931:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657940:0:6158:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a596 expref: 657 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657944:0:6158:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657964:0:6158:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a596 expref: 657 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.657971:0:6158:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20abc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a596 expref: 657 pid: 6157 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.657980:0:6158:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083774848:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.658010:0:6158:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e6ffc54e going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.661054:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.662159:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16172 00000100:00100000:0.0:1781281092.662167:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5544c15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12455:x1867808064725760:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.662192:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.662223:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20aed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5ab expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.662283:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20af4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x267:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.662314:0:8297:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a59d expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.662321:0:8297:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ff7f832d/0xce40b48e7cd20af4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x267:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.662355:0:8297:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a59d expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.662365:0:8297:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20aca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x267:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a59d expref: 659 pid: 6158 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.662377:0:8297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0b717f8 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083774912:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.662474:0:8297:0:(client.c:2500:ptlrpc_set_wait()) set 0000000031bf789d going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.665746:0:6158:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083774848:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.665776:0:6158:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668247:0:6158:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668260:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.668328:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x3ad:0x0]: returning size 57088 00000004:00200000:0.0:1781281092.668333:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.668357:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668372:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668400:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20adf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5a4 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668417:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5a4 expref: 658 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.668424:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (00000000443c972a) 00010000:00010000:0.0:1781281092.668426:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.668429:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004eec315, rc 0) 00000100:00100000:0.0:1781281092.668471:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f65a123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12456:x1867808064725696:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 10599us (11444us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.668480:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16171 00000100:00100000:0.0:1781281092.679340:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064725952 00000100:00100000:0.0:1781281092.679398:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16173 00000100:00100000:0.0:1781281092.679405:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b946b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+656:12456:x1867808064725952:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.679426:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.679446:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20afb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5b2 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679504:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679519:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679583:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679609:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679616:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679622:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679688:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679695:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679701:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679707:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ce52bfe4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.679710:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679716:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679737:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.679740:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.679744:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679750:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679762:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679766:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679771:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679776:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058d3e14b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.679777:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679782:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679788:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x7ee78a8d (0000000069107448) 00010000:00010000:0.0:1781281092.679790:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.679791:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679796:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679840:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20afb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b2 expref: 657 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679847:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20afb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b2 expref: 657 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.679855:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003af9e08b, rc 0) 00000100:00100000:0.0:1781281092.679909:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b946b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+656:12456:x1867808064725952:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 504us (671us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.679916:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16173 00000100:00100000:0.0:1781281092.683599:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726080 00000100:00100000:0.0:1781281092.683655:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16174 00000100:00100000:0.0:1781281092.683662:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049cc6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+656:12455:x1867808064726080:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.683683:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.683704:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5b9 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.683824:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x268:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.683844:0:6158:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd1c1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08aca expref: 657 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.683851:0:6158:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.683889:0:6158:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd1c1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08aca expref: 657 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.683901:0:6158:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd1c1f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08aca expref: 657 pid: 14242 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.683913:0:6158:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083774976:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.683989:0:6158:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e6ffc54e going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.688041:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726144 00000100:00100000:0.0:1781281092.688104:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16175 00000100:00100000:0.0:1781281092.688111:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f67edc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12456:x1867808064726144:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.688133:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.688154:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5c0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688217:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688232:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688242:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.688318:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f9:0x0]: returning size 11264 00000004:00200000:0.0:1781281092.688322:0:6157:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.688346:0:6157:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688372:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c0 expref: 660 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688391:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c0 expref: 659 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.688399:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.688402:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281092.688405:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058d3e14b, rc 0) 00000100:00100000:0.0:1781281092.688460:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f67edc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+659:12456:x1867808064726144:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 348us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.688467:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16175 00000100:00100000:0.0:1781281092.694015:0:6158:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083774976:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.694042:0:6158:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.694357:0:6158:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.694365:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.694384:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x268:0x0]: returning size 1867776 00010000:00010000:0.0:1781281092.694559:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b9 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.694576:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b9 expref: 658 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.694582:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000afec688e) 00010000:00010000:0.0:1781281092.694585:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1781281092.694598:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b04c8dc, rc 0) 00000100:00100000:0.0:1781281092.694624:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049cc6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12455:x1867808064726080:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 10962us (11234us total) trans 4294975370 rc 0/0 00000100:00100000:0.0:1781281092.694631:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16174 00000100:00100000:0.0:1781281092.702163:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726336 00000100:00100000:0.0:1781281092.702262:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16176 00000100:00100000:0.0:1781281092.702268:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d09db4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12455:x1867808064726336:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.702292:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.702318:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5c7 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.702373:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x268:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.702389:0:6158:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b9 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.702395:0:6158:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x268:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.702426:0:6158:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b9 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.702437:0:6158:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x268:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5b9 expref: 659 pid: 6158 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.702448:0:6158:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083775040:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.702538:0:6158:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e6ffc54e going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.709074:0:6158:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000840f1620 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6158:1867808083775040:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.709108:0:6158:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x268:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.710994:0:6158:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.711004:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.711046:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x268:0x0]: returning size 1867776 00000004:00200000:0.0:1781281092.711050:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.711069:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.711080:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.711106:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c7 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.711119:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c7 expref: 658 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.711125:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000afec688e) 00010000:00010000:0.0:1781281092.711127:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.711130:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003af9e08b, rc 0) 00000100:00100000:0.0:1781281092.711161:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d09db4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12455:x1867808064726336:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 8893us (9103us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.711169:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16176 00000100:00100000:0.0:1781281092.714927:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726592 00000100:00100000:0.0:1781281092.714984:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16178 00000100:00100000:0.0:1781281092.714991:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036340ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+658:12456:x1867808064726592:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.715012:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.715014:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1781281092.715041:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c0 expref: 658 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715059:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.715065:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281092.715078:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5d5 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715205:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715232:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715241:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715256:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20b64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715263:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20b64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.715274:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20b64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1781281092.716200:0:6158:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1bc:0x0], index 0: 0 00000040:00080000:0.0:1781281092.717894:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4912, 176 off862272 00010000:00010000:0.0:1781281092.718080:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d46e72d/0xce40b48e7cd20b6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718099:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d46e72d/0xce40b48e7cd20b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3af:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718112:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d46e72d/0xce40b48e7cd20b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3af:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718153:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718162:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718169:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718176:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.718179:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718186:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718203:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281092.718206:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.718483:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.718491:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20b5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281092.718960:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000036340ca9 reply state 0000000086ff05ec transno 4294975371 ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20b64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.719001:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5d5 expref: 660 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.719015:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008d46e72d/0xce40b48e7cd20b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3af:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5d5 expref: 659 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.719023:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (000000003886c019) 00010000:00010000:0.0:1781281092.719025:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1781281092.719027:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d46e72d, rc 0) 00000100:00100000:0.0:1781281092.719112:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036340ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+660:12456:x1867808064726592:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 4120us (4525us total) trans 4294975371 rc 0/0 00000100:00100000:0.0:1781281092.719122:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16178 00000100:00100000:0.0:1781281092.722584:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726656 00000100:00100000:0.0:1781281092.722848:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16179 00000100:00100000:0.0:1781281092.722856:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004585267b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+660:12456:x1867808064726656:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.722884:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.722907:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5dc expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.722969:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.722982:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.722992:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.723029:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.723046:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.723056:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.723076:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5dc expref: 662 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.723092:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5dc expref: 661 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.723099:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (000000003886c019) 00010000:00010000:0.0:1781281092.723102:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.723104:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b04c8dc, rc 0) 00000100:00100000:0.0:1781281092.723169:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004585267b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+661:12456:x1867808064726656:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 312us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.723176:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16179 00000100:00100000:0.0:1781281092.751589:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064726912 00000100:00100000:0.0:1781281092.751627:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064727040 00000100:00100000:0.0:1781281092.751646:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16180 00000100:00100000:0.0:1781281092.751652:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064726912:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.751675:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.751696:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5f1 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751757:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751771:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751782:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751795:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751802:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.751807:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752325:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752335:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752341:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752347:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ce52bfe4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.752350:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752356:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752486:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.752489:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.752501:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752508:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20b9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752530:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752535:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752540:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752592:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.752595:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752600:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752609:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x89e8213 (000000008f73849c) 00010000:00010000:0.0:1781281092.752611:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.752613:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752618:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20ba3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752656:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b95 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5f1 expref: 663 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752664:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20b95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5f1 expref: 663 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.752672:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008c8f5194, rc 0) 00000100:00100000:0.0:1781281092.752721:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064726912:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 1067us (2655us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.752729:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16180 00000100:00100000:0.0:1781281092.752751:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16181 00000100:00100000:0.0:1781281092.752756:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c490bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+661:12456:x1867808064727040:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281092.752788:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281092.752800:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20b80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5dc expref: 661 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.753016:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (000000003886c019) 00010000:00010000:0.0:1781281092.753020:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281092.753056:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20baa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.753067:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20baa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.753075:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20baa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281092.753267:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c490bad9 reply state 000000004d3fe601 transno 4294975372 ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20baa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281092.753483:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c490bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12456:x1867808064727040:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 725us (3373us total) trans 4294975372 rc 0/0 00000100:00100000:0.0:1781281092.753491:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16181 00000100:00100000:0.0:1781281092.759338:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064727232 00000100:00100000:0.0:1781281092.759397:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16182 00000100:00100000:0.0:1781281092.759403:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f82533d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064727232:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.759430:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.759451:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20bb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5f8 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759533:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759577:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759589:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759604:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759610:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759616:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759684:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759691:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759697:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759703:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c8f5194 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.759706:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759713:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759737:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.759740:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.759744:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759751:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20bb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759764:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759769:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759775:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759779:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.759781:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759787:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759794:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x89e8213 (000000008f73849c) 00010000:00010000:0.0:1781281092.759796:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.759798:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759808:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20bbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x89e8213 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759839:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20bb1 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5f8 expref: 663 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759846:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20bb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5f8 expref: 663 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.759854:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b04c8dc, rc 0) 00000100:00100000:0.0:1781281092.759915:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f82533d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064727232:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 510us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.759922:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16182 00000100:00100000:0.0:1781281092.766528:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064727424 00000100:00100000:0.0:1781281092.766590:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16184 00000100:00100000:0.0:1781281092.766595:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c67f8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064727424:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.766611:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.766628:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20bcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a5ff expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766681:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766694:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766703:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766717:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766736:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766743:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766815:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766822:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766828:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766833:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000150e198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.766836:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766842:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766852:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.766855:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.766858:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766869:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766882:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766888:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766893:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766898:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0693da4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.766900:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766905:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766912:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x1a6eeb7 (0000000063f0b724) 00010000:00010000:0.0:1781281092.766914:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.766917:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766921:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20bdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x1a6eeb7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766951:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20bcd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ff expref: 663 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766964:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20bcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ff expref: 663 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.766974:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ce52bfe4, rc 0) 00000100:00100000:0.0:1781281092.767016:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c67f8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+662:12455:x1867808064727424:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 420us (646us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.767024:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16184 00000100:00100000:0.0:1781281092.771472:0:7760:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064727488 00002000:00100000:0.0:1781281092.771531:0:7760:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x1bc:0x0] (0->51455) req@00000000f8529de2 x1867808064727488/t0(0) o4->a285b906-59a1-4d21-bb2d-09007a70ac15@192.168.202.40@tcp:538/0 lens 488/0 e 0 to 0 dl 1781281098 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1781281092.771569:0:7760:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f8529de2 with x1867808064727488 ext(0->51455) 00002000:00010000:0.0:1781281092.771574:0:7760:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f8529de2 00000100:00100000:0.0:1781281092.771620:0:7760:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 638 00000100:00100000:0.0:1781281092.771627:0:7760:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8529de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+78:2269:x1867808064727488:12345-192.168.202.40@tcp:4:dbench.0 00000100:00100000:0.0:1781281092.781642:0:7760:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8529de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+80:2269:x1867808064727488:12345-192.168.202.40@tcp:4:dbench.0 Request processed in 10012us (10392us total) trans 4294968053 rc 0/0 00000100:00100000:0.0:1781281092.781655:0:7760:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 638 00002000:00100000:0.0:1781281092.781668:0:7760:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x1bc:0x0] (0->51455) req@00000000f8529de2 x1867808064727488/t4294968053(0) o4->a285b906-59a1-4d21-bb2d-09007a70ac15@192.168.202.40@tcp:538/0 lens 488/448 e 0 to 0 dl 1781281098 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1781281092.781677:0:7760:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f8529de2 with x1867808064727488 ext(0->51455) 00002000:00010000:0.0:1781281092.781683:0:7760:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f8529de2 00000100:00100000:0.0:1781281092.815323:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815363:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815383:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815399:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815416:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815430:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815454:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815470:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815486:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.815534:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.818718:0:14257:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 642 00000100:00100000:0.0:1781281092.818724:0:14257:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c10cff32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a285b906-59a1-4d21-bb2d-09007a70ac15+77:2268:x1867808064728192:12345-192.168.202.40@tcp:4:dbench.0 00000100:00100000:0.0:1781281092.831606:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064728448 00000100:00100000:0.0:1781281092.831661:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16188 00000100:00100000:0.0:1781281092.831668:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d70729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+664:12455:x1867808064728448:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.831689:0:15255:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.831710:0:15255:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a614 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831778:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831794:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831805:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831819:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831830:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831835:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831906:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831914:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831921:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831926:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0693da4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.831930:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831937:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831947:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.831950:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.831953:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831958:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831976:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831982:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831987:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831992:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000150e198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.831994:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.831999:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.832004:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x5fa7b6f4 (000000008f73849c) 00010000:00010000:0.0:1781281092.832007:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.832008:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.832013:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x5fa7b6f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.832043:0:15255:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c05 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a614 expref: 665 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.832050:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a614 expref: 665 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.832059:0:15255:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ce52bfe4, rc 0) 00000100:00100000:0.0:1781281092.832124:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d70729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+664:12455:x1867808064728448:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 455us (1178us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.832132:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16188 00000100:00100000:0.0:1781281092.863514:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064728576 00000100:00100000:0.0:1781281092.864203:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16190 00000100:00100000:0.0:1781281092.864224:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006618ba35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+664:12455:x1867808064728576:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.864245:0:15255:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.864267:0:15255:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a622 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864328:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864344:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864355:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864368:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864375:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864380:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864453:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864461:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864467:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864473:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000150e198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.864476:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864483:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864494:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.864497:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.864501:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864507:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20c36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864519:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864534:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864584:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864667:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0693da4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.864669:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864675:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864682:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x24d2d01a (000000008f73849c) 00010000:00010000:0.0:1781281092.864684:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.864686:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864691:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20c3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x24d2d01a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864719:0:15255:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c2f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a622 expref: 665 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864727:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20c2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a622 expref: 665 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.864736:0:15255:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ce52bfe4, rc 0) 00000100:00100000:0.0:1781281092.864797:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006618ba35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+664:12455:x1867808064728576:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 573us (1730us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281092.864944:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16190 00000100:00100000:0.0:1781281092.877068:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009db642b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083775296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281092.877132:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281092.877162:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1781281092.877167:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083775232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281092.877182:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281092.877200:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083775360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281092.877216:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281092.877248:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083775296 00000100:00100000:0.0:1781281092.877278:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083775232 00000100:00100000:0.0:1781281092.877290:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083775360 00000100:00100000:0.0:1781281092.877306:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1781281092.877312:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da86eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3178:x1867808083775296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1781281092.877336:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:442 count 1 00010000:00010000:0.0:1781281092.877363:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000150e198/0xce40b48e7cd20c59 lrc: 3/0,1 mode: --/PW res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877383:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be194d04/0xce40b48e7cd20719 lrc: 2/0,0 mode: PR/PR res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a477 expref: 81 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1781281092.877391:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281092.877393:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281092.877396:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000150e198/0xce40b48e7cd20c59 lrc: 4/0,1 mode: --/PW res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877424:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be194d04/0xce40b48e7cd20719 lrc: 3/0,0 mode: PR/PR res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a477 expref: 81 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1781281092.877436:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be194d04/0xce40b48e7cd20719 lrc: 4/0,0 mode: PR/PR res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a477 expref: 81 pid: 14248 timeout: 715 lvb_type: 1 00000100:00100000:0.0:1781281092.877447:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017a834ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7752:1867808083775424:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.877492:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e44436ee going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.877846:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:0.0:1781281092.877851:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d00831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3178:x1867808083775232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1781281092.877866:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:441 count 1 00010000:00010000:0.0:1781281092.877878:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 3/0,1 mode: --/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877889:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d086ca/0xce40b48e7cd201ee lrc: 2/0,0 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2a2 expref: 81 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877895:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281092.877896:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281092.877897:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 4/0,1 mode: --/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877915:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3d086ca/0xce40b48e7cd201ee lrc: 3/0,0 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2a2 expref: 81 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.877921:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3d086ca/0xce40b48e7cd201ee lrc: 4/0,0 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2a2 expref: 81 pid: 8137 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.877929:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001fab021 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083775488:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.879431:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 0000000097d41610 going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.882842:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42ad109 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12456:x1867808064727680:12345-192.168.202.40@tcp:44:dbench.0 Request processed in 94469us (96039us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.882860:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16186 00000100:00100000:0.0:1781281092.886055:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064728704 00000100:00100000:0.0:1781281092.886095:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16192 00000100:00100000:0.0:1781281092.886099:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a822218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12455:x1867808064728704:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:0.0:1781281092.886115:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281092.886131:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20c75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a630 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886180:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886191:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886200:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886219:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886226:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886231:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886322:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886336:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886343:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.886374:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1fc:0x0]: returning size 260096 00000004:00200000:0.0:1781281092.886378:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281092.886394:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886405:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886413:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886418:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886424:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886429:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c8f5194 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.886432:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886439:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886453:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281092.886456:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.886459:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886464:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20c7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886474:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886478:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886483:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886488:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d874006 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281092.886489:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886494:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886499:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0xf786fdb3 (0000000063f0b724) 00010000:00010000:0.0:1781281092.886501:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281092.886503:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886512:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886562:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20c75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 618 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886575:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 617 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.886581:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (0000000028d567f6) 00010000:00010000:0.0:1781281092.886595:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281092.886598:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007b3586af, rc 0) 00000100:00100000:0.0:1781281092.886635:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a822218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+617:12455:x1867808064728704:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 534us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.886641:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16192 00000004:00080000:0.0:1781281092.892103:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009db642b7/2, rc 0, transno 1005 00000100:00100000:0.0:1781281092.892120:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009db642b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083775296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1781281092.901859:0:14277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d086ca/0xce40b48e7cd201ee lrc: 0/0,0 mode: --/PW res: [0x1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2a2 expref: 80 pid: 8137 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.901874:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001fab021 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083775488:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.901892:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 3/0,1 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.901900:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 3/0,1 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.901911:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 3/0,1 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.901919:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 3/0,1 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.901925:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b04c8dc/0xce40b48e7cd20c60 lrc: 2/0,0 mode: PW/PW res: [0x1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.901938:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281092.902342:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d00831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083775232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24490us (25158us total) trans 4294968302 rc 0/0 00000100:00100000:0.0:1781281092.902350:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000004:00080000:0.0:1781281092.902389:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000398b4a41/2, rc 0, transno 1006 00000100:00100000:0.0:1781281092.902395:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083775232:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1781281092.904390:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281092.904396:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c493c7/0xce40b48e7cd20c67 lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.904406:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a1c493c7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281092.904409:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c493c7/0xce40b48e7cd20c67 lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.904417:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c493c7/0xce40b48e7cd20c67 lrc: 3/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.904443:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c493c7/0xce40b48e7cd20c67 lrc: 1/0,0 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.904449:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c493c7/0xce40b48e7cd20c67 lrc: 0/0,0 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.904464:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281092.904466:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281092.904467:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281092.916685:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.920177:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064729152 00010000:00010000:0.0:1781281092.920295:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd20735 lrc: 5/0,0 mode: PW/PW res: [0x1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a485 expref: 93 pid: 8137 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.920339:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4770 00000100:00100000:0.0:1781281092.920346:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+93:2269:x1867808064729152:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1781281092.920363:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281092.920368:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd20735 lrc: 5/0,0 mode: PW/PW res: [0x1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a485 expref: 93 pid: 8137 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281092.920379:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd20735 lrc: 4/0,0 mode: PW/PW res: [0x1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a485 expref: 93 pid: 8137 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281092.920407:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281092.920409:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281092.920413:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20c6e lrc: 3/0,1 mode: PW/PW res: [0x1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.920427:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20c6e lrc: 4/0,1 mode: PW/PW res: [0x1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.920448:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281092.920728:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+93:2269:x1867808064729152:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 381us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.920737:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4770 00000100:00100000:0.0:1781281092.920993:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.921037:0:15255:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d530678 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083775744:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.921059:0:15255:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281092.921081:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064729216 00010000:00010000:0.0:1781281092.921096:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 619 pid: 8297 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.921117:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4771 00000100:00100000:0.0:1781281092.921123:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001d9283c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+619:2271:x1867808064729216:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1781281092.921132:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281092.921136:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 619 pid: 8297 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281092.921144:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 619 pid: 8297 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281092.921157:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20c8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a630 expref: 619 pid: 8297 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281092.921169:0:6142:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (0000000028d567f6) 00010000:00010000:0.0:1781281092.921172:0:6142:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.921180:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.921187:0:6142:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.921204:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281092.921707:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001d9283c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+618:2271:x1867808064729216:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 583us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281092.921714:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4771 00010000:00010000:0.0:1781281092.921736:0:15255:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.921743:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281092.922283:0:15255:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1fc:0x0]: returning size 260096 00010000:00010000:0.0:1781281092.922421:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000973e9517/0xce40b48e7cd20c91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a637 expref: 619 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.922437:0:15255:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20c98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1fc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a637 expref: 618 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.922444:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (0000000028d567f6) 00010000:00010000:0.0:1781281092.922447:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1781281092.922450:0:15255:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a239c66e, rc 0) 00000100:00100000:0.0:1781281092.922473:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009fd7c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+618:12455:x1867808064729088:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 21114us (21525us total) trans 4294975373 rc 0/0 00000100:00100000:0.0:1781281092.922480:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16193 00000100:00100000:0.0:1781281092.927373:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281092.966881:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064729728 00000100:00100000:0.0:1781281092.966948:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16196 00000100:00100000:0.0:1781281092.966953:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ff09754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+620:12455:x1867808064729728:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281092.967001:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281092.967025:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000054d82dea/0xce40b48e7cd037bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ad9 expref: 620 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967043:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a70bad8b/0xce40b48e7ccff86e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff27c expref: 619 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967051:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd037ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ae7 expref: 618 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967056:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f4615c42/0xce40b48e7ccff84b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ee:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff26e expref: 617 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967063:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ee:0x0].0x0 (000000000a2880eb) 00010000:00010000:0.0:1781281092.967073:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052860d12/0xce40b48e7cd02ff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00840 expref: 616 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967077:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:0.0:1781281092.967079:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281092.967114:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20cbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967127:0:8297:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd20cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a645 expref: 615 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967134:0:8297:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20cbb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967169:0:8297:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd20cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a645 expref: 615 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281092.967179:0:8297:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd20cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a645 expref: 615 pid: 15255 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281092.967188:0:8297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000320b3177 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083775872:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281092.967254:0:8297:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e44436ee going to sleep for 43 seconds 00000100:00100000:0.0:1781281092.992747:0:8297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000320b3177 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083775872:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281092.992779:0:8297:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20cbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001931:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.001938:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20cd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001947:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000001e120ad already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.001950:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20cd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001961:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001972:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ee:0x0].0x0 (0000000094032114) 00010000:00010000:0.0:1781281093.001974:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.001976:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20cd0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001982:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20cd0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.001995:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.001996:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.001997:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.007023:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.010449:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000286b2351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+74:2270:x1867808064728832:12345-192.168.202.40@tcp:16:dbench.0 Request processed in 108977us (109614us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.010462:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2916 00000100:00100000:0.0:1781281093.017483:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.022880:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064730176 00000100:00100000:0.0:1781281093.022938:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4613 00000100:00100000:0.0:1781281093.022944:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d63c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+615:12456:x1867808064730176:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:0.0:1781281093.031034:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d63c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12456:x1867808064730176:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 8088us (8238us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.031042:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4613 00000100:00100000:0.0:1781281093.035942:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281093.037760:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.037765:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd20d08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.037771:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b40e0664 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.037774:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd20d08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.037780:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd20d08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.037789:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e7:0x0].0x0 (00000000024ab4dd) 00010000:00010000:0.0:1781281093.037791:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.037794:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd20d08 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.037799:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd20d08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.037809:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.037810:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.037811:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.048252:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064730624 00000100:00100000:0.0:1781281093.048313:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4615 00000100:00100000:0.0:1781281093.048319:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c98ab4f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+615:12456:x1867808064730624:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.048570:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c98ab4f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12456:x1867808064730624:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 249us (6161us total) trans 4294975380 rc 0/0 00000100:00100000:0.0:1781281093.048578:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4615 00000100:00100000:0.0:1781281093.064453:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064731008 00000100:00100000:0.0:1781281093.064537:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4616 00000100:00100000:0.0:1781281093.064577:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+615:12519:x1867808064731008:12345-192.168.202.40@tcp:37:ll_sa_12456.0 00000100:00100000:0.0:1781281093.076168:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+617:12519:x1867808064731008:12345-192.168.202.40@tcp:37:ll_sa_12456.0 Request processed in 11582us (19071us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.076184:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4616 00000040:00080000:0.0:1781281093.083374:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].387, 64 off33088 00000040:00080000:0.0:1781281093.083394:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4916, 184 off863008 00010000:00010000:0.0:1781281093.083466:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083481:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083491:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083513:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083527:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083533:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.083578:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.084187:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000022d0dabc reply state 0000000060952420 transno 4294975381 ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084309:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084316:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084322:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084327:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bc376c9a already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.084329:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084335:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084345:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:0.0:1781281093.084347:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.084349:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.084355:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd20d5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.084363:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000022d0dabc reply state 0000000060952420 transno 4294975381 ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.084462:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022d0dabc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12456:x1867808064730944:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 25000us (27390us total) trans 4294975381 rc 0/0 00000100:00100000:0.0:1781281093.084474:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16203 00000100:00100000:0.0:1781281093.095386:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.095505:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.104892:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.104994:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.105026:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.105108:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.105147:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064731584 00000100:00100000:0.0:1781281093.105190:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064731712 00000100:00100000:0.0:1781281093.105222:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16205 00000100:00100000:0.0:1781281093.105228:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063f803a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+618:12523:x1867808064731584:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:0.0:1781281093.105250:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281093.105271:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a66f expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105310:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a66f expref: 619 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105324:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a66f expref: 619 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105331:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:0.0:1781281093.105333:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.105337:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d874006, rc 0) 00000100:00100000:0.0:1781281093.105387:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063f803a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+619:12523:x1867808064731584:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.105395:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16205 00000100:00100000:0.0:1781281093.105477:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16206 00000100:00100000:0.0:1781281093.105481:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+618:12456:x1867808064731712:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.105570:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.105742:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007e61313e/0xce40b48e7cd0350d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c009dd expref: 618 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105765:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089bdbc2f/0xce40b48e7ccff78e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff21a expref: 617 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105778:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e33fafca/0xce40b48e7cd0354c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ec:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00a07 expref: 616 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105788:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005d71f49/0xce40b48e7ccff76b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ec:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff213 expref: 615 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105796:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ec:0x0].0x0 (0000000044ce0065) 00010000:00010000:0.0:1781281093.105810:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.105840:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105850:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105858:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105872:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105883:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.105888:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106000:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106006:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106012:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.106361:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].388, 64 off33152 00000040:00080000:0.0:1781281093.106381:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4917, 184 off863192 00010000:00010000:0.0:1781281093.106441:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106450:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106457:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106464:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106474:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.106479:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd20db0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107708:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.107746:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000001fab021 reply state 00000000dbfc9f2c transno 4294975383 ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107942:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107950:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107956:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107962:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007b3586af already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.107966:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107972:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.107986:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:0.0:1781281093.107989:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.107994:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.108000:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd20d9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.108010:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000001fab021 reply state 00000000dbfc9f2c transno 4294975383 ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.108101:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+616:12456:x1867808064731712:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2616us (2991us total) trans 4294975383 rc 0/0 00000100:00100000:0.0:1781281093.108111:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16206 00000100:00100000:0.0:1781281093.127948:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.141961:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.142005:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.142043:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064732288 00010000:00010000:0.0:1781281093.142093:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a66f expref: 612 pid: 6158 timeout: 715 lvb_type: 0 00000100:00100000:0.0:1781281093.142145:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4775 00000100:00100000:0.0:1781281093.142151:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+612:2271:x1867808064732288:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1781281093.142170:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281093.142178:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a66f expref: 613 pid: 6158 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281093.142191:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd20d94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a66f expref: 613 pid: 6158 timeout: 715 lvb_type: 0 00010000:00010000:0.0:1781281093.142231:0:6143:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:0.0:1781281093.142239:0:6143:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20db7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.142322:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20db7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.142330:0:6143:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20db7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.147649:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281093.147719:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+609:2271:x1867808064732288:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 5564us (5712us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.147729:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4775 00000100:00100000:0.0:1781281093.160444:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064732672 00000100:00100000:0.0:1781281093.160500:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4623 00000100:00100000:0.0:1781281093.160508:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+611:12455:x1867808064732672:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.160818:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+612:12455:x1867808064732672:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 309us (700us total) trans 4294975390 rc 0/0 00000100:00100000:0.0:1781281093.160827:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4623 00000100:00100000:0.0:1781281093.162281:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.162478:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.162812:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.172884:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064732992 00000100:00100000:0.0:1781281093.172939:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4624 00000100:00100000:0.0:1781281093.172946:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012218d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+614:12456:x1867808064732992:12345-192.168.202.40@tcp:37:dbench.0 00010000:00010000:0.0:1781281093.177962:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.177978:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.177985:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.178388:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].390, 64 off33280 00000040:00080000:0.0:1781281093.178409:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4921, 184 off863928 00010000:00010000:0.0:1781281093.178479:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178490:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178498:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178505:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178511:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178527:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd20e82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178577:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.178682:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e81add84 reply state 000000008883cbd0 transno 4294975391 ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178747:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178759:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178773:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178790:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f2f64278 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.178793:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178801:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178813:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:0.0:1781281093.178816:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.178819:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.178824:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd20e6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.178834:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e81add84 reply state 000000008883cbd0 transno 4294975391 ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.178930:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e81add84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+614:12455:x1867808064733120:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1673us (1967us total) trans 4294975391 rc 0/0 00000100:00100000:0.0:1781281093.178940:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16214 00000100:00100000:0.0:1781281093.192194:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.192235:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.192536:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.192739:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064733440 00000100:00100000:0.0:1781281093.192770:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16215 00000100:00100000:0.0:1781281093.192777:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cccad6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+614:12527:x1867808064733440:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:0.0:1781281093.192805:0:15255:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281093.192828:0:15255:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20e89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a692 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.192868:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20e89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a692 expref: 615 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.192883:0:15255:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20e89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a692 expref: 615 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.192892:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.192894:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.192898:0:15255:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000eae1aa5, rc 0) 00000100:00100000:0.0:1781281093.192947:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cccad6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+615:12527:x1867808064733440:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.192954:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16215 00000100:00100000:0.0:1781281093.199513:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.199684:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.199721:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.222761:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064733888 00000100:00100000:0.0:1781281093.222844:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4628 00000100:00100000:0.0:1781281093.222855:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b903037c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+609:12455:x1867808064733888:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.223221:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b903037c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+610:12455:x1867808064733888:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 367us (6819us total) trans 4294975396 rc 0/0 00000100:00100000:0.0:1781281093.223230:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4628 00000100:00100000:0.0:1781281093.227299:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064734080 00000100:00100000:0.0:1781281093.227400:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4629 00000100:00100000:0.0:1781281093.227407:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+610:12456:x1867808064734080:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.227696:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+611:12456:x1867808064734080:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 288us (4852us total) trans 4294975397 rc 0/0 00000100:00100000:0.0:1781281093.227703:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4629 00000100:00100000:0.0:1781281093.231470:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.231830:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.237069:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd20ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.237081:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd20ee4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.237092:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.237095:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.237098:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd20ee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.237103:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd20ee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.237115:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f9a52d16 reply state 00000000b6809da2 transno 4294975399 ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.237211:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a52d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+607:12456:x1867808064734336:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2136us (5379us total) trans 4294975399 rc 0/0 00000100:00100000:2.0:1781281093.237219:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16219 00010000:00010000:0.0:1781281093.243129:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.243154:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xb0449b87 (00000000f8403935) 00010000:00010000:0.0:1781281093.243157:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.243164:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.243170:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x38d:0x0].0x0 (000000007f54b4c0) 00010000:00010000:0.0:1781281093.243172:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.258264:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.258332:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.259532:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064734720 00000100:00100000:0.0:1781281093.259615:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16220 00000100:00100000:0.0:1781281093.259620:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+609:12456:x1867808064734720:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.259661:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.259689:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003cbfe1fc/0xce40b48e7cd1faaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x39d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09fd8 expref: 609 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259711:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a08ae00e/0xce40b48e7cd1f8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x39d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09f22 expref: 608 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259723:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd1fae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x39d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09fe6 expref: 607 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259735:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059112750/0xce40b48e7cd1db7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x39d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09424 expref: 606 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259744:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39d:0x0].0x0 (00000000fcf11d1d) 00010000:00010000:0.0:1781281093.259753:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.259781:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259796:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259807:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259822:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x283705e2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259829:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259840:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259965:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x39d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259973:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.259980:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.260408:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].386, 64 off32896 00000040:00080000:0.0:1781281093.260429:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4926, 184 off864840 00010000:00010000:0.0:1781281093.260487:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260497:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260504:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260512:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260529:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260591:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd20f15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x39d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260610:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.260628:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df460404 reply state 00000000d6c171f0 transno 4294975402 ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260675:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260681:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260687:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260693:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a51be36f already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.260696:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260702:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260713:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.260716:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.260719:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.260725:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.260733:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df460404 reply state 00000000d6c171f0 transno 4294975402 ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.260822:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+607:12456:x1867808064734720:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1199us (2488us total) trans 4294975402 rc 0/0 00000100:00100000:0.0:1781281093.260832:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16220 00000100:00100000:2.0:1781281093.263357:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.263656:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064734848 00000100:00100000:0.0:1781281093.263727:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16221 00000100:00100000:0.0:1781281093.263734:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+607:12455:x1867808064734848:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.263794:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.263819:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd1b462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08647 expref: 607 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263840:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058df793f/0xce40b48e7cd03d48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00c92 expref: 606 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263852:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a4e847d1/0xce40b48e7cd03d9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00cb5 expref: 605 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263861:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7ccffcab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff420 expref: 604 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263869:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f8:0x0].0x0 (00000000bd179f84) 00010000:00010000:0.0:1781281093.263877:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.263910:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263929:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263939:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263951:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263957:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.263963:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.264059:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.264067:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.264073:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.264440:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].392, 64 off33408 00000040:00080000:0.0:1781281093.264461:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4927, 184 off865024 00010000:00010000:0.0:1781281093.264530:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266685:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266717:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266727:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266732:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266738:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266825:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.266851:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000087552764 reply state 0000000056cc6e99 transno 4294975403 ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266911:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266917:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266923:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266928:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b96f5953 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.266931:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266941:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266952:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:0.0:1781281093.266955:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.266958:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.266963:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.266971:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000087552764 reply state 0000000056cc6e99 transno 4294975403 ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.267071:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+605:12455:x1867808064734848:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 3334us (3718us total) trans 4294975403 rc 0/0 00000100:00100000:0.0:1781281093.267080:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16221 00010000:00010000:0.0:1781281093.268713:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.268726:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x283705e2 (0000000069107448) 00010000:00010000:0.0:1781281093.268728:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.268732:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.268738:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39d:0x0].0x0 (000000009603256c) 00010000:00010000:0.0:1781281093.268740:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281093.272286:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.272300:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.272315:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000eae1aa5 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.272319:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.272334:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.272352:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f8:0x0].0x0 (00000000a8fb9562) 00010000:00010000:2.0:1781281093.272354:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.272357:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.272363:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd20f31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.272377:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.272379:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.272380:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.283355:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064735104 00000100:00100000:2.0:1781281093.283413:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16222 00000100:00100000:2.0:1781281093.283419:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ece1721 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+606:12456:x1867808064735104:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.283473:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.283501:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000aa8dbc7/0xce40b48e7cd1fd17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x242:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a0b8 expref: 606 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283537:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072792880/0xce40b48e7cd07851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x242:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01fe0 expref: 605 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283612:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d8f40e/0xce40b48e7cd07890 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x242:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01ffc expref: 604 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283630:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f1025eef/0xce40b48e7cd01afe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x242:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00013 expref: 603 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283640:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x242:0x0].0x0 (00000000c6c6d716) 00010000:00010000:2.0:1781281093.283651:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.283688:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283703:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283715:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283730:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283738:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283745:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283861:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283869:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.283880:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.284501:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].393, 64 off33472 00000040:00080000:2.0:1781281093.284533:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4928, 184 off865208 00010000:00010000:2.0:1781281093.284663:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284676:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284685:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284693:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284699:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284705:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284731:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.284753:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006ece1721 reply state 000000005442f4e8 transno 4294975405 ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284778:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.284782:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284790:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000076d35719 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.284793:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284801:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284812:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x242:0x0].0x0 (00000000ca557496) 00010000:00010000:2.0:1781281093.284814:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.284818:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284823:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284836:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.284837:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.284838:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.284880:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284888:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284894:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284899:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f8b8042 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.284902:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284908:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284916:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.284918:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.284920:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.284925:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.284933:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006ece1721 reply state 000000005442f4e8 transno 4294975405 ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.285025:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ece1721 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+604:12456:x1867808064735104:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1603us (1860us total) trans 4294975405 rc 0/0 00000100:00100000:2.0:1781281093.285035:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16222 00010000:00010000:0.0:1781281093.285569:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.285591:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x8344d724 (000000005676ce9a) 00010000:00010000:0.0:1781281093.285594:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.285598:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.285604:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f8:0x0].0x0 (00000000a8fb9562) 00010000:00010000:0.0:1781281093.285606:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281093.295257:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.295276:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x103f9c81 (0000000072b6f67d) 00010000:00010000:2.0:1781281093.295279:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.295285:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.295292:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x242:0x0].0x0 (00000000ca557496) 00010000:00010000:2.0:1781281093.295294:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.295448:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064735168 00000100:00100000:0.0:1781281093.295494:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16223 00000100:00100000:0.0:1781281093.295500:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b758d73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+606:2271:x1867808064735168:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:0.0:1781281093.295528:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281093.295562:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a699 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295627:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295639:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295648:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295661:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295668:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295678:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295769:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295777:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.295784:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281093.295958:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x225:0x0]: returning size 11264 00000004:00200000:0.0:1781281093.295963:0:6157:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281093.295994:0:6157:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296005:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296010:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296017:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296022:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a51be36f already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.296025:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296037:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296049:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:0.0:1781281093.296052:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.296055:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296061:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd20f5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296072:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296077:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296082:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296087:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c4098104 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.296088:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296093:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296977:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xf17aab4e (00000000606951b7) 00010000:00010000:0.0:1781281093.296980:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.296985:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.296991:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd20f62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.297022:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd20f54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a699 expref: 609 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.297033:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a699 expref: 608 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.297039:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:0.0:1781281093.297041:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281093.297042:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467f022c, rc 0) 00000100:00100000:0.0:1781281093.297068:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b758d73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+608:2271:x1867808064735168:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 1568us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.297074:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16223 00000100:00100000:2.0:1781281093.298649:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012218d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+606:12455:x1867808064735232:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 5246us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.298661:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4633 00010000:00010000:0.0:1781281093.317452:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.317479:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xc3f00931 (000000003dcc4780) 00010000:00010000:0.0:1781281093.317482:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.317488:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.317494:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x240:0x0].0x0 (00000000609343e4) 00010000:00010000:0.0:1781281093.317496:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.323952:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064735616 00000100:00100000:0.0:1781281093.324007:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064735744 00000100:00100000:0.0:1781281093.324035:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4635 00000100:00100000:0.0:1781281093.324042:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1b8f82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+605:12456:x1867808064735616:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.324302:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1b8f82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+606:12456:x1867808064735616:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 258us (522us total) trans 4294975408 rc 0/0 00000100:00100000:0.0:1781281093.324309:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4635 00000100:00100000:0.0:1781281093.324329:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4636 00000100:00100000:0.0:1781281093.324333:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+605:12455:x1867808064735744:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.324408:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+606:12455:x1867808064735744:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 73us (571us total) trans 4294975409 rc 0/0 00000100:00100000:0.0:1781281093.324415:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4636 00000100:00100000:2.0:1781281093.330246:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064735936 00000100:00100000:2.0:1781281093.330313:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16226 00000100:00100000:2.0:1781281093.330320:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a382e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+607:12456:x1867808064735936:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.330380:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.330407:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd1ff5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x254:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a19f expref: 607 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330431:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019fbe3c8/0xce40b48e7cd088ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x254:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02543 expref: 606 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330443:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007a8e213/0xce40b48e7cd08945 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x254:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02558 expref: 605 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330454:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006207f7f2/0xce40b48e7cd021e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x254:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0030e expref: 604 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330470:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x254:0x0].0x0 (0000000017993610) 00010000:00010000:2.0:1781281093.330480:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.330513:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330536:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330599:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330620:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330628:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330635:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330931:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330940:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.330946:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.331651:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].395, 64 off33600 00000040:00080000:2.0:1781281093.331672:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4930, 184 off865576 00010000:00010000:2.0:1781281093.332250:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x254:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332263:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332272:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332284:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332359:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332365:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd20fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332444:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.332465:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004a382e03 reply state 0000000022b91feb transno 4294975410 ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332590:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332597:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332603:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332608:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f8b8042 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.332611:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332618:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332633:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.332636:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.332640:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.332646:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd20f93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.332660:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004a382e03 reply state 0000000022b91feb transno 4294975410 ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.332763:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a382e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+605:12456:x1867808064735936:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2440us (2663us total) trans 4294975410 rc 0/0 00000100:00100000:2.0:1781281093.332771:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16226 00000100:00100000:2.0:1781281093.338536:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.338612:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.338735:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.338745:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x3afecd66 (00000000d9241932) 00010000:00010000:2.0:1781281093.338747:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.338762:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.338768:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x254:0x0].0x0 (00000000d4e8571b) 00010000:00010000:2.0:1781281093.338770:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.345571:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.355908:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.356031:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281093.360095:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd20f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a0 expref: 600 pid: 6158 timeout: 716 lvb_type: 0 00000100:00100000:0.0:1781281093.360147:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4777 00000100:00100000:0.0:1781281093.360154:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+600:2269:x1867808064736448:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1781281093.360172:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281093.360178:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd20f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a0 expref: 600 pid: 6158 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.360189:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd20f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a0 expref: 600 pid: 6158 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.360209:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd20f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a0 expref: 600 pid: 6158 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.360233:0:6143:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:0.0:1781281093.360237:0:6143:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd20faf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.360247:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd20faf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.360254:0:6143:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd20faf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.360293:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281093.360346:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+599:2269:x1867808064736448:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 192us (4315us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.360355:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4777 00010000:00010000:2.0:1781281093.364271:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281093.364278:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd20fcb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364296:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004713c698 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.364300:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd20fcb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364307:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd20fcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364319:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24e:0x0].0x0 (00000000a342a45b) 00010000:00010000:2.0:1781281093.364321:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.364324:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd20fcb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364330:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd20fcb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364346:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.364349:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd20fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364354:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000d073645 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.364355:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd20fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364360:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd20fe0 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364367:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x223:0x0].0x0 (00000000bd179f84) 00010000:00010000:2.0:1781281093.364369:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.364370:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd20fe0 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.364376:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.364377:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.364379:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.366372:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.369345:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.369366:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xcbe2ca0f (0000000096e5d688) 00010000:00010000:2.0:1781281093.369369:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.369374:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.369380:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x223:0x0].0x0 (00000000bd179f84) 00010000:00010000:2.0:1781281093.369383:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.374384:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.375337:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f484cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+602:12455:x1867808064736704:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 750us (959us total) trans 4294975415 rc 0/0 00000100:00100000:2.0:1781281093.375347:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4640 00000100:00100000:0.0:1781281093.377068:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.379036:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.384908:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.384923:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x10cfb8f0 (00000000da5ecacc) 00010000:00010000:2.0:1781281093.384925:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.384929:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.384939:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21f:0x0].0x0 (0000000020ee1426) 00010000:00010000:2.0:1781281093.384941:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.388482:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.388700:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737088 00000100:00100000:0.0:1781281093.388759:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4641 00000100:00100000:0.0:1781281093.388765:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+598:12456:x1867808064737088:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.389118:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+599:12456:x1867808064737088:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 352us (645us total) trans 4294975418 rc 0/0 00000100:00100000:0.0:1781281093.389127:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4641 00000100:00100000:0.0:1781281093.390849:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737216 00000100:00100000:0.0:1781281093.390889:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4642 00000100:00100000:0.0:1781281093.390895:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c188eca pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+599:12455:x1867808064737216:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.391071:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c188eca pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+600:12455:x1867808064737216:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 176us (362us total) trans 4294975419 rc 0/0 00000100:00100000:0.0:1781281093.391079:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4642 00000100:00100000:2.0:1781281093.391958:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.392067:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737344 00000100:00100000:0.0:1781281093.392142:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16231 00000100:00100000:0.0:1781281093.392148:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fce62496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+600:12456:x1867808064737344:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.392193:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.392220:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd1feec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x250:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a16e expref: 600 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392245:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073c52d0e/0xce40b48e7cd08508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x250:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02416 expref: 599 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392258:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087b7b834/0xce40b48e7cd0857f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x250:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02439 expref: 598 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392272:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd02061 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x250:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00266 expref: 597 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392293:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x250:0x0].0x0 (000000006694c32b) 00010000:00010000:0.0:1781281093.392304:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.392336:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392350:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392361:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392378:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392384:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392390:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392484:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x250:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392491:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392497:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.392894:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].399, 64 off33856 00000040:00080000:0.0:1781281093.392916:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4935, 184 off866496 00010000:00010000:0.0:1781281093.392971:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x250:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392981:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.392988:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393000:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393006:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393012:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21034 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393032:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.393048:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fce62496 reply state 00000000baf20616 transno 4294975420 ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393096:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393102:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393109:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393115:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b96f5953 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.393119:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393127:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393141:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.393143:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.393146:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.393152:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd2101f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.393160:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fce62496 reply state 00000000baf20616 transno 4294975420 ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.393497:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fce62496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+598:12456:x1867808064737344:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1346us (1540us total) trans 4294975420 rc 0/0 00000100:00100000:0.0:1781281093.393505:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16231 00000100:00100000:0.0:1781281093.397563:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737472 00000100:00100000:0.0:1781281093.397613:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16232 00000100:00100000:0.0:1781281093.397619:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a00ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+598:12455:x1867808064737472:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.397676:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.397701:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd1349b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x221:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0604c expref: 598 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397725:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b4dbc692/0xce40b48e7cd05b08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x221:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01647 expref: 597 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397739:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd05b55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x221:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01663 expref: 596 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397772:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ef07dac3/0xce40b48e7cd00db4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x221:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffae8 expref: 595 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397781:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x221:0x0].0x0 (0000000024b7a74e) 00010000:00010000:0.0:1781281093.397790:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.397821:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397835:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397844:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397858:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397865:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397870:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397971:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x221:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397980:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.397992:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.398357:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].388, 64 off33024 00000040:00080000:0.0:1781281093.398376:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4936, 176 off866672 00010000:00010000:0.0:1781281093.398435:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x221:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398445:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x221:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398453:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x221:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398460:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x221:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398466:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x221:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398472:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21050 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x221:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398495:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.398514:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001a00ccc7 reply state 00000000d9548ee1 transno 4294975421 ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398591:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398602:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398608:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398614:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.398617:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398624:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398633:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:0.0:1781281093.398636:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.398640:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.398645:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd2103b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.398654:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001a00ccc7 reply state 00000000d9548ee1 transno 4294975421 ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.398735:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a00ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+596:12455:x1867808064737472:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1113us (1349us total) trans 4294975421 rc 0/0 00000100:00100000:0.0:1781281093.398743:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16232 00000100:00100000:2.0:1781281093.411991:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.412044:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.412087:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737600 00000100:00100000:2.0:1781281093.412131:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737728 00000100:00100000:2.0:1781281093.412152:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4643 00000100:00100000:2.0:1781281093.412159:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ce6d3b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+597:12455:x1867808064737600:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.412419:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ce6d3b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+598:12455:x1867808064737600:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 259us (436us total) trans 4294975422 rc 0/0 00000100:00100000:2.0:1781281093.412428:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4643 00000100:00100000:2.0:1781281093.412474:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4644 00000100:00100000:2.0:1781281093.412480:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+597:12456:x1867808064737728:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.412616:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+598:12456:x1867808064737728:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 135us (573us total) trans 4294975423 rc 0/0 00000100:00100000:2.0:1781281093.412623:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4644 00000100:00100000:0.0:1781281093.416403:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281093.418925:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418936:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418942:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418946:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000853f7b12 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.418950:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418955:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418963:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:3.0:1781281093.418966:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.418968:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.418972:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd21057 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.418980:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000556ce00d reply state 0000000085d60642 transno 4294975424 ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.419082:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000556ce00d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+596:12456:x1867808064737856:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2335us (2684us total) trans 4294975424 rc 0/0 00000100:00100000:3.0:1781281093.419091:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16233 00000100:00100000:2.0:1781281093.426363:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.426473:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064737984 00000100:00100000:3.0:1781281093.426539:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16234 00000100:00100000:3.0:1781281093.426573:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2994d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+596:12455:x1867808064737984:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.426631:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.426659:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd12bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05d74 expref: 596 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426684:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd0553c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x219:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0145d expref: 595 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426697:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099acfe19/0xce40b48e7cd0557b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x219:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01487 expref: 594 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426709:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d472da5f/0xce40b48e7cd00a7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x219:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff983 expref: 593 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426719:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x219:0x0].0x0 (00000000ef36d1c8) 00010000:00010000:3.0:1781281093.426728:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.426912:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426928:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426938:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426954:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426961:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.426968:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.427071:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x219:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.427079:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.427085:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.428662:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].389, 64 off33088 00000040:00080000:3.0:1781281093.428685:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4938, 184 off867040 00010000:00010000:3.0:1781281093.428932:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x219:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.428947:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.428958:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.428965:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.428972:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.428983:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429067:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.429089:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a2994d9b reply state 000000000f3a8d24 transno 4294975425 ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429144:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429150:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429157:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429163:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bdda106f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.429167:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429174:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429185:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:3.0:1781281093.429187:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.429191:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.429197:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21073 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.429206:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a2994d9b reply state 000000000f3a8d24 transno 4294975425 ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.429306:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2994d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+594:12455:x1867808064737984:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2731us (2951us total) trans 4294975425 rc 0/0 00000100:00100000:3.0:1781281093.429316:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16234 00000100:00100000:2.0:1781281093.434181:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.434257:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064738112 00000100:00100000:3.0:1781281093.434322:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4645 00000100:00100000:3.0:1781281093.434329:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a56045fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+594:12456:x1867808064738112:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.434629:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a56045fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+595:12456:x1867808064738112:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 299us (459us total) trans 4294975426 rc 0/0 00000100:00100000:3.0:1781281093.434637:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4645 00010000:00010000:0.0:1781281093.435172:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.435179:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.435191:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fe4dded7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.435194:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.435213:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.435229:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x219:0x0].0x0 (00000000f8db1abb) 00010000:00010000:0.0:1781281093.435231:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.435235:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.435241:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21088 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.435257:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.435259:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.435260:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.436309:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.436319:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x1e0192a5 (00000000410e827e) 00010000:00010000:2.0:1781281093.436321:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.436325:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.436330:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x219:0x0].0x0 (00000000f8db1abb) 00010000:00010000:2.0:1781281093.436332:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.437036:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.437107:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064738240 00000100:00100000:0.0:1781281093.437156:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4646 00000100:00100000:0.0:1781281093.437163:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+595:12455:x1867808064738240:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.437529:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+596:12455:x1867808064738240:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 364us (495us total) trans 4294975427 rc 0/0 00000100:00100000:0.0:1781281093.437537:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4646 00000100:00100000:3.0:1781281093.442702:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281093.444578:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.444584:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd210a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.444593:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073e3cde8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.444596:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd210a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.444602:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd210a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x39b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.444611:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39b:0x0].0x0 (000000002dbfad65) 00010000:00010000:3.0:1781281093.444614:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.444617:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd210a4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x39b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.444622:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd210a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x39b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.444632:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.444633:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.444634:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.459375:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.460534:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.460568:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd210c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.460588:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8d5f517 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.460592:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd210c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.460604:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd210c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.460626:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21b:0x0].0x0 (000000005eeae6e6) 00010000:00010000:2.0:1781281093.460632:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.460636:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd210c0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.460643:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd210c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.460654:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.460656:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.460658:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.467021:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.467056:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.467094:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064738624 00000100:00100000:3.0:1781281093.467142:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064738752 00000100:00100000:3.0:1781281093.467163:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4647 00000100:00100000:3.0:1781281093.467169:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000623e19f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+594:12456:x1867808064738624:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.467406:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000623e19f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+595:12456:x1867808064738624:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 235us (392us total) trans 4294975430 rc 0/0 00000100:00100000:3.0:1781281093.467416:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4647 00010000:00010000:2.0:1781281093.467704:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.467715:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x801dd473 (00000000742bbe43) 00010000:00010000:2.0:1781281093.467717:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.467721:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.467727:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21b:0x0].0x0 (000000005eeae6e6) 00010000:00010000:2.0:1781281093.467729:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.469707:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.469868:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064738880 00000100:00100000:0.0:1781281093.469917:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16237 00000100:00100000:0.0:1781281093.469923:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae80e5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+595:12456:x1867808064738880:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.469969:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.469994:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd1fc5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a072 expref: 595 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470014:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd073d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01e66 expref: 594 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470026:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053c4addd/0xce40b48e7cd073f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01e74 expref: 593 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470036:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd0197d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff72 expref: 592 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470047:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23e:0x0].0x0 (00000000f0ccaad0) 00010000:00010000:0.0:1781281093.470054:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.470081:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470094:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470103:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470116:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x17d46a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470123:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470129:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470214:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470220:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.470227:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.470992:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].401, 64 off33984 00000040:00080000:0.0:1781281093.471012:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4941, 184 off867592 00010000:00010000:0.0:1781281093.471074:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471086:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471095:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471102:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471108:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471118:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd210dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471141:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.471157:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ae80e5ca reply state 000000004f3f4f09 transno 4294975432 ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471199:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471205:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471211:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471216:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.471219:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471226:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471236:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.471239:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.471244:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.471248:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd210c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.471257:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ae80e5ca reply state 000000004f3f4f09 transno 4294975432 ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.471463:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.472049:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae80e5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+590:12456:x1867808064738880:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2123us (2347us total) trans 4294975432 rc 0/0 00000100:00100000:0.0:1781281093.472059:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16237 00010000:00010000:3.0:1781281093.472981:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.472985:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd210f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.472992:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b40e0664 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.472995:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd210f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.473000:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd210f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.473013:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x213:0x0].0x0 (000000001c8eb13a) 00010000:00010000:3.0:1781281093.473015:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.473017:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd210f8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.473022:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd210f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.473032:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.473033:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.473034:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.487505:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.487526:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x5a3b2e4f (00000000f5a2dddf) 00010000:00010000:2.0:1781281093.487528:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.487531:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.487537:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x213:0x0].0x0 (000000001c8eb13a) 00010000:00010000:2.0:1781281093.487567:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.492354:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.492642:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739264 00000100:00100000:0.0:1781281093.492697:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4649 00000100:00100000:0.0:1781281093.492703:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bde2c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+591:12456:x1867808064739264:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.492944:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bde2c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+592:12456:x1867808064739264:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 240us (598us total) trans 4294975434 rc 0/0 00000100:00100000:0.0:1781281093.492952:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4649 00000100:00100000:3.0:1781281093.499299:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.500226:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739392 00000100:00100000:2.0:1781281093.500264:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16239 00000100:00100000:2.0:1781281093.500268:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f85244d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+593:12456:x1867808064739392:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.500308:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.500334:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd1f1da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09c90 expref: 593 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500357:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea06dc01/0xce40b48e7cd0709b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01d5c expref: 592 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500373:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069add047/0xce40b48e7cd070ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01d78 expref: 591 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500387:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d653e868/0xce40b48e7cd017e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffebc expref: 590 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500399:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23a:0x0].0x0 (0000000070b84328) 00010000:00010000:2.0:1781281093.500411:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.500437:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500452:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500463:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500478:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500484:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500491:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500630:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500642:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.500649:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.501199:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].402, 64 off34048 00000040:00080000:2.0:1781281093.501221:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4943, 184 off867960 00010000:00010000:2.0:1781281093.502362:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502385:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502396:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502405:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502411:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502417:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502448:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.502470:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f85244d8 reply state 0000000067f3b8ca transno 4294975436 ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502561:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502568:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502574:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502578:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.502580:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f8b8042 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.502585:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502586:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502604:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502605:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f9e3574b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.502609:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502621:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.502621:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.502627:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.502631:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502637:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23a:0x0].0x0 (000000005f3d5608) 00010000:00010000:2.0:1781281093.502639:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd210ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502642:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.502645:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.502650:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f85244d8 reply state 0000000067f3b8ca transno 4294975436 ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502670:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21114 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.502684:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.502685:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.502687:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.502933:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f85244d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+591:12456:x1867808064739392:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2661us (2775us total) trans 4294975436 rc 0/0 00000100:00100000:2.0:1781281093.502947:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16239 00000100:00100000:2.0:1781281093.517170:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739520 00000100:00100000:2.0:1781281093.517297:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16240 00000100:00100000:2.0:1781281093.517305:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007de72e08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+591:12455:x1867808064739520:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.517441:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.517616:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a3d7cdc7/0xce40b48e7cd12b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05d43 expref: 591 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517646:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000887c7a60/0xce40b48e7cd0530c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x217:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c013ae expref: 590 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517657:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd05375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x217:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c013d8 expref: 589 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517667:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd009bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x217:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff936 expref: 588 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517676:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x217:0x0].0x0 (000000002615b5c4) 00010000:00010000:2.0:1781281093.517686:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.517730:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517748:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517761:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517789:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.517797:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.522725:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.522904:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739648 00000100:00100000:0.0:1781281093.522960:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4651 00000100:00100000:0.0:1781281093.522967:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+588:12456:x1867808064739648:12345-192.168.202.40@tcp:35:dbench.0 00010000:00010000:2.0:1781281093.522997:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.523210:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+589:12456:x1867808064739648:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 242us (492us total) trans 4294975437 rc 0/0 00000100:00100000:0.0:1781281093.523218:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4651 00010000:00010000:0.0:1781281093.523346:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x217:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523360:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523368:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.523727:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].393, 64 off33344 00000040:00080000:0.0:1781281093.523826:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4944, 184 off868144 00010000:00010000:0.0:1781281093.523874:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x217:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523883:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523890:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523897:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523902:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523907:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523930:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.523943:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007de72e08 reply state 000000006b1a3708 transno 4294975438 ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523986:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.523993:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524005:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.524005:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524012:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.524014:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073bb39ee already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.524020:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524023:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004419fc48 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.524028:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.524032:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524037:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.524047:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:2.0:1781281093.524050:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x217:0x0].0x0 (00000000ea2b21e9) 00010000:00010000:0.0:1781281093.524052:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.524055:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.524058:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524059:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524079:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd21130 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.524079:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2111b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.524104:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007de72e08 reply state 000000006b1a3708 transno 4294975438 ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.524108:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.524111:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.524113:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.524172:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007de72e08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+590:12455:x1867808064739520:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 6866us (7134us total) trans 4294975438 rc 0/0 00000100:00100000:0.0:1781281093.524180:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16240 00010000:00010000:2.0:1781281093.526704:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.526727:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xd60b5417 (000000005e66bc2b) 00010000:00010000:2.0:1781281093.526729:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.526735:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.526741:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x217:0x0].0x0 (00000000ea2b21e9) 00010000:00010000:2.0:1781281093.526743:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.531301:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.531350:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.531435:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739904 00000100:00100000:3.0:1781281093.531468:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064739776 00000100:00100000:3.0:1781281093.531529:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4652 00000100:00100000:0.0:1781281093.531529:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16241 00000100:00100000:3.0:1781281093.531563:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000070c478 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+591:12455:x1867808064739776:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.531563:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f7d2e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+591:12456:x1867808064739904:12345-192.168.202.40@tcp:36:dbench.0 00000100:00100000:3.0:1781281093.531916:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000070c478 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+592:12455:x1867808064739776:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 376us (622us total) trans 4294975439 rc 0/0 00000100:00100000:3.0:1781281093.531924:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4652 00010000:00010000:0.0:1781281093.534054:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.534098:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd1ff24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x252:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a18a expref: 591 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534125:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b7fc8bf8/0xce40b48e7cd08700 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x252:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c024b0 expref: 590 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534137:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e6ca892/0xce40b48e7cd087a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x252:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c024ef expref: 589 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534148:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd02125 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x252:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002ba expref: 588 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534157:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x252:0x0].0x0 (00000000de116828) 00010000:00010000:0.0:1781281093.534168:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.534210:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534226:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534236:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534252:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534259:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534270:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534371:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534379:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.534385:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.535104:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].403, 64 off34112 00000040:00080000:0.0:1781281093.535126:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4945, 184 off868328 00010000:00010000:0.0:1781281093.535193:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535218:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535226:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535233:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535239:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535249:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd2114c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.535266:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.535285:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e1f7d2e1 reply state 00000000569d4b4a transno 4294975440 ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536012:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536022:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536027:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536032:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058d3e14b already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.536034:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536039:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536048:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.536050:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.536052:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.536056:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21137 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.536064:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e1f7d2e1 reply state 00000000569d4b4a transno 4294975440 ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.536165:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f7d2e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+589:12456:x1867808064739904:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 4624us (4812us total) trans 4294975440 rc 0/0 00000100:00100000:0.0:1781281093.536175:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16241 00000100:00100000:2.0:1781281093.545408:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.545471:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740032 00000100:00100000:0.0:1781281093.545609:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16242 00000100:00100000:0.0:1781281093.545616:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c2ccc88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+589:12455:x1867808064740032:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.545669:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.545697:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001fa8d7db/0xce40b48e7cd139b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c061e9 expref: 589 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.545720:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd04d39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c011c4 expref: 588 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.545733:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b7723270/0xce40b48e7cd04d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c011e7 expref: 587 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.545745:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8dcf334/0xce40b48e7cd0068a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7d8 expref: 586 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.545754:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20f:0x0].0x0 (000000003c8da993) 00010000:00010000:0.0:1781281093.545764:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.545808:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.545828:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546073:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546091:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546099:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546105:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546222:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546231:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.546237:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.546790:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].394, 64 off33408 00000004:00080000:0.0:1781281093.546797:0:6157:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 616251255006ns, next at 617251252200ns, rc = 0 00000040:00080000:0.0:1781281093.547024:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4947, 184 off868536 00010000:00010000:0.0:1781281093.547092:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547108:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547115:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547122:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547127:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547132:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547207:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.547228:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c2ccc88 reply state 000000008cd38a54 transno 4294975441 ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547275:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547281:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547287:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547292:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d874006 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.547296:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547302:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547312:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:0.0:1781281093.547314:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.547327:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.547333:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd21153 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.547342:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c2ccc88 reply state 000000008cd38a54 transno 4294975441 ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.547663:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c2ccc88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+587:12455:x1867808064740032:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2042us (2259us total) trans 4294975441 rc 0/0 00000100:00100000:0.0:1781281093.547672:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16242 00010000:00010000:3.0:1781281093.548294:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.548301:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.548311:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058d3e14b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.548314:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.548720:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.548735:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20f:0x0].0x0 (000000003342ddda) 00010000:00010000:3.0:1781281093.548737:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.548742:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.548747:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21168 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.549077:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.549080:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.549082:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.552639:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.552740:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740160 00000100:00100000:2.0:1781281093.552802:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4653 00000100:00100000:2.0:1781281093.552815:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+587:12456:x1867808064740160:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.553051:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+588:12456:x1867808064740160:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 236us (421us total) trans 4294975442 rc 0/0 00000100:00100000:2.0:1781281093.553059:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4653 00010000:00010000:3.0:1781281093.560031:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.560052:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xbfd87aeb (00000000b65a5f9b) 00010000:00010000:3.0:1781281093.560055:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.560059:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.560065:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20f:0x0].0x0 (000000003342ddda) 00010000:00010000:3.0:1781281093.560066:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.561587:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.561671:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740288 00000100:00100000:0.0:1781281093.561720:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16243 00000100:00100000:0.0:1781281093.561726:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f12aa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+588:12456:x1867808064740288:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.561782:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.561811:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000de256dbd/0xce40b48e7cd1d5ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x391:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09210 expref: 588 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561845:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd1c7b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x391:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08ce5 expref: 587 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561858:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ad9ff12/0xce40b48e7cd1d620 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x391:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09225 expref: 586 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561869:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd1c69f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x391:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08c6e expref: 585 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561878:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x391:0x0].0x0 (00000000ab645b08) 00010000:00010000:0.0:1781281093.561888:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.561923:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561935:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561944:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561955:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x5a114248 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561961:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.561966:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562060:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x391:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562066:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562071:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.562385:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].395, 64 off33472 00000040:00080000:0.0:1781281093.562404:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4948, 184 off868720 00010000:00010000:0.0:1781281093.562457:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x391:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562466:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x391:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562474:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x391:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562481:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x391:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562487:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x391:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562492:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd21184 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x391:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562533:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.562577:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f12aa75 reply state 00000000e1aa8755 transno 4294975443 ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562618:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562624:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562630:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562635:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f89b0034 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.562639:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562645:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562653:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.562656:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.562659:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.562663:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd2116f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.562670:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f12aa75 reply state 00000000e1aa8755 transno 4294975443 ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.562743:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f12aa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+586:12456:x1867808064740288:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1015us (1162us total) trans 4294975443 rc 0/0 00000100:00100000:0.0:1781281093.562752:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16243 00010000:00010000:0.0:1781281093.567178:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.567195:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x5a114248 (0000000052ea8322) 00010000:00010000:0.0:1781281093.567198:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.567212:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.567218:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x391:0x0].0x0 (000000008e5c50fc) 00010000:00010000:0.0:1781281093.567220:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.567272:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740416 00000100:00100000:3.0:1781281093.567322:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4654 00000100:00100000:3.0:1781281093.567327:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+586:12455:x1867808064740416:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.567591:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+587:12455:x1867808064740416:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 263us (536us total) trans 4294975444 rc 0/0 00000100:00100000:3.0:1781281093.567599:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4654 00000100:00100000:0.0:1781281093.571147:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.571257:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740544 00000100:00100000:2.0:1781281093.571315:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4655 00000100:00100000:2.0:1781281093.571331:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000754ad4cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+587:12456:x1867808064740544:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.573973:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000754ad4cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+588:12456:x1867808064740544:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 1158us (1349us total) trans 4294975445 rc 0/0 00000100:00100000:2.0:1781281093.573995:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4655 00000100:00100000:0.0:1781281093.577278:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.582284:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740800 00000100:00100000:2.0:1781281093.582351:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16245 00000100:00100000:2.0:1781281093.582358:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cf74694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+586:12456:x1867808064740800:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.582420:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.582449:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd1fbb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x258:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a033 expref: 586 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582474:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d5fbd4/0xce40b48e7cd08d43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x258:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02693 expref: 585 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582485:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066daf337/0xce40b48e7cd08dcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x258:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c026c4 expref: 584 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582499:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000329dedbe/0xce40b48e7cd02386 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x258:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003bd expref: 583 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582509:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x258:0x0].0x0 (00000000e0a65966) 00010000:00010000:2.0:1781281093.582526:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.582602:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582617:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582626:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582645:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582651:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582656:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582750:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582757:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.582762:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.583172:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].404, 64 off34176 00000040:00080000:2.0:1781281093.583193:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4950, 184 off869088 00010000:00010000:2.0:1781281093.583254:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583263:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583270:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583281:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583286:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583291:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583313:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.583331:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cf74694 reply state 0000000096222949 transno 4294975447 ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583353:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.583358:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583363:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d0d9c9e1 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.583366:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583373:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583383:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x258:0x0].0x0 (000000003d7deaa6) 00010000:00010000:2.0:1781281093.583386:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.583388:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583398:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583408:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.583409:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.583410:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.583448:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583455:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583460:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583464:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000077f3d35f already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.583467:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583473:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583479:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.583481:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.583483:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.583488:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.583501:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cf74694 reply state 0000000096222949 transno 4294975447 ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.583656:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cf74694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12456:x1867808064740800:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1296us (1481us total) trans 4294975447 rc 0/0 00000100:00100000:2.0:1781281093.583665:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16245 00010000:00010000:3.0:1781281093.587847:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.587870:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xa3962d5b (00000000b09df161) 00010000:00010000:3.0:1781281093.587873:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.587878:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.587883:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x258:0x0].0x0 (000000003d7deaa6) 00010000:00010000:3.0:1781281093.587885:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281093.588427:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588443:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588452:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588459:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588465:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588471:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.588502:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.588534:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000053b277dd reply state 0000000068aa94eb transno 4294975446 ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589112:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.589119:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589128:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f89b0034 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.589131:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589139:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589152:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21d:0x0].0x0 (0000000012777891) 00010000:00010000:2.0:1781281093.589155:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.589158:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589163:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd211bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.589179:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.589180:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.589182:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.589339:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589346:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589351:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589356:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000176d5151 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.589358:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589363:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589372:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:0.0:1781281093.589375:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.589377:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.589382:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd2118b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.589391:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000053b277dd reply state 0000000068aa94eb transno 4294975446 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.589675:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053b277dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12455:x1867808064740672:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 12131us (12401us total) trans 4294975446 rc 0/0 00000100:00100000:0.0:1781281093.589685:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16244 00000100:00100000:3.0:1781281093.594406:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.594581:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064740928 00000100:00100000:0.0:1781281093.594627:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4656 00000100:00100000:0.0:1781281093.594634:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12456:x1867808064740928:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.594899:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+585:12456:x1867808064740928:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 264us (500us total) trans 4294975448 rc 0/0 00000100:00100000:0.0:1781281093.594907:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4656 00000100:00100000:3.0:1781281093.601375:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281093.601451:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.601470:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xee1a16ec (000000003c8da993) 00010000:00010000:0.0:1781281093.601473:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.601477:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.601483:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21d:0x0].0x0 (0000000012777891) 00010000:00010000:0.0:1781281093.601485:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.603757:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.603848:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741184 00000100:00100000:0.0:1781281093.603894:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16246 00000100:00100000:0.0:1781281093.603901:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5058fa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+586:12456:x1867808064741184:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.603953:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.603979:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd1fd5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x244:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a0d4 expref: 586 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604001:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003f9b95fa/0xce40b48e7cd07b8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x244:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c020f8 expref: 585 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604014:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a14bf5be/0xce40b48e7cd07bca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x244:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0211b expref: 584 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604025:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f6db5379/0xce40b48e7cd01c0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x244:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0007c expref: 583 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604036:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x244:0x0].0x0 (00000000df751442) 00010000:00010000:0.0:1781281093.604048:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.604075:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604089:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604098:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604112:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604119:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604126:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604238:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x244:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604247:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604253:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.604656:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].397, 64 off33600 00000040:00080000:0.0:1781281093.604677:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4951, 184 off869272 00010000:00010000:0.0:1781281093.604733:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x244:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604742:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604749:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604756:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604761:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604766:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604802:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.604818:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c5058fa8 reply state 000000007ba242e4 transno 4294975450 ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604861:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604867:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604874:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604879:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.604883:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604889:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604897:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.604900:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.604903:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.604908:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd211c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.604916:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c5058fa8 reply state 000000007ba242e4 transno 4294975450 ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.604988:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5058fa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12456:x1867808064741184:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1086us (1236us total) trans 4294975450 rc 0/0 00000100:00100000:0.0:1781281093.604996:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16246 00010000:00010000:2.0:1781281093.605166:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.605171:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.605178:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af240689 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.605180:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.605186:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.605194:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x244:0x0].0x0 (0000000097a35972) 00010000:00010000:2.0:1781281093.605196:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.605198:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.605202:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd211d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x244:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.605212:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.605213:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.605214:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.610971:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.610996:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x2ee4e5f8 (0000000044ce0065) 00010000:00010000:3.0:1781281093.610999:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.611004:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.611010:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x244:0x0].0x0 (0000000097a35972) 00010000:00010000:3.0:1781281093.611012:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.613495:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.613590:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.613684:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741440 00000100:00100000:0.0:1781281093.614084:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4658 00000100:00100000:0.0:1781281093.614092:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a93075c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12456:x1867808064741440:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.614335:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a93075c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+585:12456:x1867808064741440:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 242us (744us total) trans 4294975451 rc 0/0 00000100:00100000:0.0:1781281093.614343:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4658 00000040:00080000:2.0:1781281093.620563:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].398, 64 off33664 00000040:00080000:2.0:1781281093.620596:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4952, 184 off869456 00010000:00010000:2.0:1781281093.620693:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x215:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620720:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620736:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620743:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620748:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620754:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd211f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620773:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.620792:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000065fc3517 reply state 0000000013d8ae85 transno 4294975452 ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620852:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620858:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620865:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620871:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eb7c1166 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.620874:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620886:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620898:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:2.0:1781281093.620901:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.620905:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.620910:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd211df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.620919:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000065fc3517 reply state 0000000013d8ae85 transno 4294975452 ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.621004:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065fc3517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+583:12455:x1867808064741312:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 6032us (7514us total) trans 4294975452 rc 0/0 00000100:00100000:2.0:1781281093.621014:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16247 00000100:00100000:3.0:1781281093.621617:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.622172:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741568 00000100:00100000:2.0:1781281093.622220:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16248 00000100:00100000:2.0:1781281093.622226:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083c709e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+583:12456:x1867808064741568:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.622268:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.622286:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd1f17f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x236:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09c74 expref: 583 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622299:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd06c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x236:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01bf7 expref: 582 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622315:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea904499/0xce40b48e7cd06ca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x236:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01c1a expref: 581 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622325:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003b2ecfc/0xce40b48e7cd0163c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x236:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe14 expref: 580 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622335:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x236:0x0].0x0 (000000009d91471f) 00010000:00010000:2.0:1781281093.622344:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.622371:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622382:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622391:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622405:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622411:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622417:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622511:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x236:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622531:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.622537:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.624272:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].405, 64 off34240 00000004:00080000:2.0:1781281093.624283:0:15255:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 616328740285ns, next at 617328736988ns, rc = 0 00000040:00080000:2.0:1781281093.624308:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4953, 184 off869640 00010000:00010000:2.0:1781281093.624390:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x236:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624404:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624415:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624422:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624428:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624434:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624508:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.624537:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000083c709e9 reply state 00000000bd80794e transno 4294975453 ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624612:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624619:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624625:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624631:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d0d9c9e1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.624634:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624640:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624651:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.624654:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.624657:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.624662:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd211fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.624671:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000083c709e9 reply state 00000000bd80794e transno 4294975453 ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.625508:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083c709e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+581:12456:x1867808064741568:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 3279us (3891us total) trans 4294975453 rc 0/0 00000100:00100000:2.0:1781281093.625530:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16248 00010000:00010000:0.0:1781281093.625763:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.625770:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.625777:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b9b5863 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.625780:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.625786:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.625799:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x236:0x0].0x0 (00000000e0a65966) 00010000:00010000:0.0:1781281093.625802:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.625805:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.625810:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21210 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x236:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.630049:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.630056:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.630058:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.630615:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741696 00000100:00100000:2.0:1781281093.630664:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4659 00000100:00100000:2.0:1781281093.630670:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+581:12455:x1867808064741696:12345-192.168.202.40@tcp:35:dbench.0 00010000:00010000:0.0:1781281093.630770:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.630783:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xc5f130b7 (0000000047ead7b5) 00010000:00010000:0.0:1781281093.630786:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.630791:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.630797:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x215:0x0].0x0 (00000000f0ccaad0) 00010000:00010000:0.0:1781281093.630799:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.632601:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+582:12455:x1867808064741696:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 1921us (2118us total) trans 4294975454 rc 0/0 00000100:00100000:2.0:1781281093.632616:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4659 00000100:00100000:3.0:1781281093.635318:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741824 00000100:00100000:3.0:1781281093.635372:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16249 00000100:00100000:3.0:1781281093.635378:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029a90b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+582:12455:x1867808064741824:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.635433:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.635461:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c17188/0xce40b48e7cd13837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c06172 expref: 582 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635483:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ab010b44/0xce40b48e7cd04e4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x211:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0121f expref: 581 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635510:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd04e7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x211:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0122d expref: 580 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635578:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002221f73d/0xce40b48e7cd0076a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x211:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff833 expref: 579 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635588:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x211:0x0].0x0 (000000007222a54c) 00010000:00010000:3.0:1781281093.635598:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.635628:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635640:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635650:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635664:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635670:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635676:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635771:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x211:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635782:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.635788:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.636158:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].399, 64 off33728 00000040:00080000:3.0:1781281093.636180:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4954, 184 off869824 00010000:00010000:3.0:1781281093.636240:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636250:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636257:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636263:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636267:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636272:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2122c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636297:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.636314:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000029a90b3b reply state 000000002c2fff30 transno 4294975455 ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636365:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636371:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636378:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636383:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bdda106f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.636387:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636393:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636402:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:3.0:1781281093.636405:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.636408:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.636414:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21217 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.636422:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000029a90b3b reply state 000000002c2fff30 transno 4294975455 ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.636496:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029a90b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+580:12455:x1867808064741824:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1115us (1251us total) trans 4294975455 rc 0/0 00000100:00100000:3.0:1781281093.636505:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16249 00010000:00010000:3.0:1781281093.636936:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.636938:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.636939:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.637827:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.637855:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x5e0db83a (0000000053ed986e) 00010000:00010000:2.0:1781281093.637858:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.637863:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.637869:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x236:0x0].0x0 (00000000e0a65966) 00010000:00010000:2.0:1781281093.637871:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281093.643599:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.643623:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xb65fef2a (00000000e99b6916) 00010000:00010000:0.0:1781281093.643626:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.643631:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.643637:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x211:0x0].0x0 (000000007eb77f68) 00010000:00010000:0.0:1781281093.643639:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.644580:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742080 00000100:00100000:0.0:1781281093.644634:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742208 00000100:00100000:0.0:1781281093.644666:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4660 00000100:00100000:0.0:1781281093.644672:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+581:12455:x1867808064742080:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:3.0:1781281093.649293:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741888 00000100:00100000:3.0:1781281093.649347:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742016 00000100:00100000:3.0:1781281093.649367:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16250 00000100:00100000:3.0:1781281093.649374:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003a27455 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+584:2268:x1867808064741888:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00000100:00100000:3.0:1781281093.649398:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16251 00000100:00100000:3.0:1781281093.649402:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030731f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+584:2268:x1867808064742016:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:3.0:1781281093.649417:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281093.649438:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21233 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6b5 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650083:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650101:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650113:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650130:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650136:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650143:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650328:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd21248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650337:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd21248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650344:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd21248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281093.650776:0:6155:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22d:0x0]: returning size 11264 00000004:00200000:3.0:1781281093.650781:0:6155:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281093.650882:0:6155:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd21248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650893:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650898:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650903:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650909:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000020fcd940 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.650987:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.650999:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651010:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281093.651013:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.651017:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651022:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd2123a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651032:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651038:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651043:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651048:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006a66655 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.651050:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651055:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651062:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x46e192ec (00000000734acab8) 00010000:00010000:3.0:1781281093.651064:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.651066:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651070:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd21241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651103:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6b5 expref: 586 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651113:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc376c9a/0xce40b48e7cd21248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6b5 expref: 585 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.651118:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:3.0:1781281093.651120:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281093.651122:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bc376c9a, rc 0) 00000100:00100000:3.0:1781281093.651524:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030731f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+585:2268:x1867808064742016:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 2110us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.651534:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16251 00010000:00010000:2.0:1781281093.651605:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281093.651623:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2124f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6a7 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651668:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651679:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651688:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651702:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651710:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651716:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651789:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651798:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651805:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281093.651841:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x235:0x0]: returning size 12288 00000004:00200000:2.0:1781281093.651844:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281093.651860:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651868:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651872:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651877:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651882:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b9b5863 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.651885:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651890:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651897:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:2.0:1781281093.651900:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.651903:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651908:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd21256 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651917:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651922:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651926:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651931:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000077f3d35f already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.651933:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651937:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651943:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x56ca4f59 (0000000070b84328) 00010000:00010000:2.0:1781281093.651945:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.651947:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651952:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd2125d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651973:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2124f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a7 expref: 586 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651983:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a7 expref: 585 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.651989:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281093.651991:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281093.651993:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da730b65, rc 0) 00000100:00100000:3.0:1781281093.652002:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064741952 00000100:00100000:2.0:1781281093.652025:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003a27455 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+586:2268:x1867808064741888:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 2650us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.652033:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16250 00000100:00100000:3.0:1781281093.652048:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16252 00000100:00100000:3.0:1781281093.652056:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000243be12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+585:2268:x1867808064741952:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:3.0:1781281093.652067:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281093.652076:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2126b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6ae expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652103:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652112:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652120:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652130:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652135:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652140:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652189:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652320:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652329:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281093.652471:0:6155:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x25f:0x0]: returning size 11264 00000004:00200000:3.0:1781281093.652475:0:6155:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281093.652492:0:6155:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652671:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652677:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652683:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652688:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fe4dded7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.652690:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652696:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652704:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281093.652706:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.652709:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652714:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fe4dded7/0xce40b48e7cd21272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652722:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652728:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652732:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652737:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007330163a already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.652738:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652744:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652750:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x106120ec (0000000050f37f98) 00010000:00010000:3.0:1781281093.652752:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.652753:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652758:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007330163a/0xce40b48e7cd21279 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652778:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e70cb38b/0xce40b48e7cd2126b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ae expref: 587 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652788:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ae expref: 586 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.652793:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000b7eeb9bd) 00010000:00010000:3.0:1781281093.652795:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281093.652797:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058d3e14b, rc 0) 00000100:00100000:3.0:1781281093.653702:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000243be12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+586:2268:x1867808064741952:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 1642us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.653713:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16252 00000100:00100000:3.0:1781281093.658433:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742336 00000100:00100000:3.0:1781281093.658490:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16253 00000100:00100000:3.0:1781281093.658521:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e59730c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+586:12456:x1867808064742336:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.658616:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.658645:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd1fe4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a12f expref: 586 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658668:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020977041/0xce40b48e7cd081a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c022f0 expref: 585 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658679:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007f661449/0xce40b48e7cd081f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0231a expref: 584 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658691:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a3f714c2/0xce40b48e7cd01ed9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001be expref: 583 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658701:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24c:0x0].0x0 (0000000031a80ae1) 00010000:00010000:3.0:1781281093.658710:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.658741:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658755:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658764:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658777:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658784:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658789:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.658902:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.659323:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.659334:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.660064:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].406, 64 off34304 00000040:00080000:3.0:1781281093.660082:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4955, 184 off870008 00010000:00010000:3.0:1781281093.660148:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.660160:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.660169:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.660176:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.660182:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.660187:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd2129c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.660938:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+582:12455:x1867808064742080:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 16262us (16530us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.660950:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4660 00010000:00010000:3.0:1781281093.661181:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.661208:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e59730c3 reply state 00000000d0758ddf transno 4294975457 ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661264:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661271:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661277:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661282:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bdda106f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.661286:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661292:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661305:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:3.0:1781281093.661308:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.661312:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.661318:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bdda106f/0xce40b48e7cd21287 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.661326:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e59730c3 reply state 00000000d0758ddf transno 4294975457 ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.661380:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e59730c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+582:12456:x1867808064742336:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2867us (3442us total) trans 4294975457 rc 0/0 00000100:00100000:3.0:1781281093.661387:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16253 00010000:00010000:2.0:1781281093.664683:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.664685:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.664687:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.664840:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.664851:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x9e362f1b (00000000734acab8) 00010000:00010000:2.0:1781281093.664853:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.664857:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.664862:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24c:0x0].0x0 (00000000aafc3dbe) 00010000:00010000:2.0:1781281093.664864:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.673220:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.673262:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.673506:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742400 00000100:00100000:3.0:1781281093.673601:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16254 00000100:00100000:3.0:1781281093.673608:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9a65af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+582:12531:x1867808064742400:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:3.0:1781281093.673631:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281093.673653:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6bc expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.673688:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6bc expref: 583 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.673701:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6bc expref: 583 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.673709:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:3.0:1781281093.673712:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.673715:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000073bb39ee, rc 0) 00000100:00100000:3.0:1781281093.673769:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9a65af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+583:12531:x1867808064742400:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 160us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.673777:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16254 00000100:00100000:0.0:1781281093.674080:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.674157:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742528 00000100:00100000:2.0:1781281093.674189:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742656 00000100:00100000:2.0:1781281093.674208:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4662 00000100:00100000:2.0:1781281093.674212:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12455:x1867808064742528:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.674409:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+585:12455:x1867808064742528:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 196us (1148us total) trans 4294975458 rc 0/0 00000100:00100000:2.0:1781281093.674416:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4662 00000100:00100000:2.0:1781281093.674431:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4663 00000100:00100000:2.0:1781281093.674434:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+584:12456:x1867808064742656:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.674505:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+585:12456:x1867808064742656:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 69us (426us total) trans 4294975459 rc 0/0 00000100:00100000:2.0:1781281093.674511:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4663 00000100:00100000:3.0:1781281093.680678:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.680771:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.680851:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.685588:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742784 00000100:00100000:2.0:1781281093.685711:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064742976 00010000:00010000:0.0:1781281093.688857:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.688866:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd212bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.688877:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073e3cde8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.688881:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd212bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.688888:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd212bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.688902:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x246:0x0].0x0 (000000001fc861df) 00010000:00010000:0.0:1781281093.688904:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.688906:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd212bf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.689166:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd212bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.689184:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.689185:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.689187:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.692648:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+579:12531:x1867808064742848:12345-192.168.202.40@tcp:37:ll_sa_12455.0 Request processed in 11666us (11870us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.692671:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4664 00000100:00100000:3.0:1781281093.693323:0:6155:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6571539 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6155:1867808083776192:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281093.693352:0:6155:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd212c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.693989:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.694124:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064743104 00000100:00100000:3.0:1781281093.694172:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4665 00000100:00100000:3.0:1781281093.694178:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c15430a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+579:12456:x1867808064743104:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.694384:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c15430a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+580:12456:x1867808064743104:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 205us (399us total) trans 4294975461 rc 0/0 00000100:00100000:3.0:1781281093.694391:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4665 00000100:00100000:2.0:1781281093.697794:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281093.699414:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.699419:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd212e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.699426:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f624da37 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.699429:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd212e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.699434:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd212e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.699443:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24a:0x0].0x0 (00000000cbb89717) 00010000:00010000:0.0:1781281093.699445:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.699447:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd212e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.699452:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd212e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.699462:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.699464:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.699465:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.705291:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.705448:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.705537:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.705584:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x76821429 (00000000c6c6d716) 00010000:00010000:2.0:1781281093.705587:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.705593:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.705604:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24a:0x0].0x0 (00000000cbb89717) 00010000:00010000:2.0:1781281093.705606:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.705839:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064743424 00000100:00100000:3.0:1781281093.705914:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4666 00000100:00100000:3.0:1781281093.705922:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+578:12456:x1867808064743424:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.706178:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+579:12456:x1867808064743424:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 256us (730us total) trans 4294975463 rc 0/0 00000100:00100000:3.0:1781281093.706186:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4666 00000100:00100000:0.0:1781281093.707737:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4778 00000100:00100000:0.0:1781281093.707744:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+579:2270:x1867808064743296:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1781281093.707762:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281093.707768:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6bc expref: 579 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.707780:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6bc expref: 579 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.707814:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd212a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6bc expref: 579 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.707827:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:0.0:1781281093.707831:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd212c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.707840:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd212c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.707847:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd212c6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.707877:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281093.707926:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+578:2270:x1867808064743296:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 182us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.707932:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4778 00010000:00010000:2.0:1781281093.709379:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.709384:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd212f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.709391:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058fc6128 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.709394:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd212f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.709400:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd212f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.709409:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x206:0x0].0x0 (00000000ff1a171b) 00010000:00010000:2.0:1781281093.709412:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.709414:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd212f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.709418:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd212f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.709428:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.709430:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.709431:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.712438:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.713956:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.714084:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064743552 00000100:00100000:2.0:1781281093.714128:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16258 00000100:00100000:2.0:1781281093.714135:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ede073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+579:12456:x1867808064743552:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.714183:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.714221:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd1fde9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x248:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a10c expref: 579 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714242:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000202ea8e2/0xce40b48e7cd07dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x248:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c021b5 expref: 578 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714253:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8bf55d7/0xce40b48e7cd07e40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x248:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c021d8 expref: 577 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714264:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd01d51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x248:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00116 expref: 576 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714274:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x248:0x0].0x0 (00000000b48a84b7) 00010000:00010000:2.0:1781281093.714282:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.714313:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714327:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714337:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714350:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x6324417e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714356:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714367:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714454:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x248:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714460:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714465:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.714855:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].410, 64 off34560 00000040:00080000:2.0:1781281093.714875:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4959, 184 off870744 00010000:00010000:2.0:1781281093.714939:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x248:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714949:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714957:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714963:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714969:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714979:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.714998:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.715016:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c2ede073 reply state 000000001f966436 transno 4294975465 ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715063:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715069:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715075:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715081:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d0d9c9e1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.715084:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715091:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715100:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.715103:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.715105:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.715110:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd212fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.715119:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c2ede073 reply state 000000001f966436 transno 4294975465 ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.715188:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ede073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12456:x1867808064743552:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1052us (1239us total) trans 4294975465 rc 0/0 00000100:00100000:2.0:1781281093.715196:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16258 00010000:00010000:0.0:1781281093.715581:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.715587:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.715599:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f5a1775 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.715602:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.715608:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.715618:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x248:0x0].0x0 (00000000277c4245) 00010000:00010000:0.0:1781281093.715620:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.715622:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.715627:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd21313 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.715637:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.715638:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.715639:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.719386:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000018fe6ec6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3178:1867808083776320:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719457:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719483:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3178:1867808083776576:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719504:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719528:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d734d079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3178:1867808083776832:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719577:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719590:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000477367a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1781281093.719611:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719633:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1781281093.719638:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007879add7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47603186-6904-49ab-a5a2-ed3a7a058862:3178:1867808083776256:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719666:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719681:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056e36f6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083776512:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719703:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719718:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000623e19f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083776768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719738:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719751:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9611f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777024:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719766:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719793:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009896e16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3176:1867808083776448:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719831:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719846:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776704:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719865:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719879:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091f3bea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776960:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719895:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719909:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1781281093.719914:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e667aa3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776384:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719932:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719944:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3176:1867808083776640:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719962:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.719974:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000985213de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3176:1867808083776896:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.719993:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281093.720021:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777088 00000100:00100000:0.0:1781281093.720059:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1781281093.720064:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dde405 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083777088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1781281093.720083:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 258670592 pending 6815744 free 3805282304 avail 3803185152 00000100:00100000:0.0:1781281093.720120:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dde405 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083777088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720126:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1781281093.720149:0:6151:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776256 00000100:00100000:0.0:1781281093.720169:0:6151:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1781281093.720172:0:6151:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9302c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47603186-6904-49ab-a5a2-ed3a7a058862+23:3178:x1867808083776256:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720196:0:6151:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9302c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47603186-6904-49ab-a5a2-ed3a7a058862+23:3178:x1867808083776256:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720202:0:6151:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1781281093.720224:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776512 00000100:00100000:0.0:1781281093.720243:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776384 00000100:00100000:0.0:1781281093.720251:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1781281093.720254:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e35e8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083776512:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720279:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e35e8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083776512:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720284:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1781281093.720293:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1781281093.720296:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000945231b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776384:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720318:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000945231b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776384:12345-0@lo:400:kworker/u8:1.0 Request processed in 21us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720323:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1781281093.720338:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776768 00000100:00100000:0.0:1781281093.720355:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777024 00000100:00100000:0.0:1781281093.720365:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776704 00000100:00100000:0.0:1781281093.720379:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776960 00000100:00100000:0.0:1781281093.720394:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1781281093.720397:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3178:x1867808083776768:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720423:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3178:x1867808083776768:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720429:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1781281093.720439:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1781281093.720442:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb275633 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083777024:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720463:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb275633 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083777024:12345-0@lo:400:kworker/u8:1.0 Request processed in 20us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720468:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1781281093.720476:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1781281093.720480:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c996d9a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776704:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720502:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c996d9a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776704:12345-0@lo:400:kworker/u8:1.0 Request processed in 21us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720507:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1781281093.720530:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1781281093.720533:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c847f2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776960:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720586:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c847f2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083776960:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.720592:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1781281093.720636:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007879add7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47603186-6904-49ab-a5a2-ed3a7a058862:3178:1867808083776256:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720649:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056e36f6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083776512:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720657:0:3178:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968049 gen 2 00000004:00080000:0.0:1781281093.720662:0:3178:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000068983bef, transno 4294968046 00000004:00080000:0.0:1781281093.720672:0:3178:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008362d394, transno 4294968047 00000004:00080000:0.0:1781281093.720675:0:3178:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000398f68c1, transno 4294968048 00000004:00080000:0.0:1781281093.720677:0:3178:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a36bb8b8, transno 4294968049 00000100:00100000:0.0:1781281093.720682:0:3178:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@00000000062097c0 x1867808083775616/t4294968060(4294968060) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1781281136 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000100:00100000:0.0:1781281093.720690:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000623e19f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083776768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720701:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9611f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777024:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720713:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000477367a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1781281093.720760:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e667aa3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776384:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720770:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776704:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.720778:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091f3bea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083776960:0@lo:400:kworker/u8:1.0 00000040:00100000:0.0:1781281093.720839:0:8123:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 4 records, first 376 in log [0x3:0x1:0x0] 00000004:00080000:0.0:1781281093.720974:0:8123:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 20 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1781281093.721026:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776320 00000100:00100000:0.0:1781281093.721045:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776576 00000100:00100000:0.0:1781281093.721055:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776832 00000100:00100000:0.0:1781281093.721063:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776448 00000100:00100000:0.0:1781281093.721071:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776640 00000100:00100000:0.0:1781281093.721081:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083776896 00000100:00100000:0.0:1781281093.721091:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1781281093.721094:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f62f9c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3178:x1867808083776320:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721131:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f62f9c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3178:x1867808083776320:12345-0@lo:400:kworker/u8:1.0 Request processed in 36us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721137:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1781281093.721161:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000018fe6ec6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3178:1867808083776320:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721180:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1781281093.721183:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53ff83e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3178:x1867808083776576:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721208:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53ff83e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3178:x1867808083776576:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721213:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1781281093.721230:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3178:1867808083776576:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721243:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1781281093.721246:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cfebd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3178:x1867808083776832:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721272:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cfebd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3178:x1867808083776832:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721277:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1781281093.721296:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d734d079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3178:1867808083776832:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721311:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1781281093.721315:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090696628 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3176:x1867808083776448:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721342:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090696628 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3176:x1867808083776448:12345-0@lo:400:kworker/u8:1.0 Request processed in 26us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721348:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1781281093.721368:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009896e16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3176:1867808083776448:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721384:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1781281093.721388:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b43932bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3176:x1867808083776640:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721412:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b43932bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3176:x1867808083776640:12345-0@lo:400:kworker/u8:1.0 Request processed in 23us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721417:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00010000:00080000:0.0:1781281093.721436:0:3176:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000e2c9fe8d x1867808083776640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281137 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1781281093.721445:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3176:1867808083776640:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721460:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1781281093.721464:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc9b797 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3176:x1867808083776896:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281093.721488:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc9b797 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3176:x1867808083776896:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.721494:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00010000:00080000:0.0:1781281093.721529:0:3176:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000985213de x1867808083776896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281137 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1781281093.721537:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000985213de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3176:1867808083776896:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1781281093.721896:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.721929:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.721942:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xf4ed591 (000000000df4fed4) 00010000:00010000:2.0:1781281093.721945:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.721950:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.721956:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x206:0x0].0x0 (00000000ff1a171b) 00010000:00010000:2.0:1781281093.721958:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.721973:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064743680 00000100:00100000:2.0:1781281093.721998:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4667 00000100:00100000:2.0:1781281093.722002:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014b3fce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12455:x1867808064743680:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.722170:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014b3fce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+578:12455:x1867808064743680:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 166us (275us total) trans 4294975466 rc 0/0 00000100:00100000:2.0:1781281093.722176:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4667 00000100:00100000:2.0:1781281093.726153:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777152 00000100:00100000:2.0:1781281093.726203:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1781281093.726208:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c5fede4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083777152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1781281093.726235:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 258670592 pending 6815744 free 3805282304 avail 3803185152 00000100:00100000:2.0:1781281093.726280:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c5fede4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083777152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.726287:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:2.0:1781281093.726320:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.726332:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x6324417e (0000000070b84328) 00010000:00010000:2.0:1781281093.726335:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.726339:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.726345:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x248:0x0].0x0 (00000000277c4245) 00010000:00010000:2.0:1781281093.726347:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.726387:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d03547c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083777152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1781281093.727649:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.727770:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.727809:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064743936 00000100:00100000:2.0:1781281093.727848:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4668 00000100:00100000:2.0:1781281093.727853:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+578:12456:x1867808064743936:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.728082:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+579:12456:x1867808064743936:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 228us (312us total) trans 4294975467 rc 0/0 00000100:00100000:2.0:1781281093.728089:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4668 00000100:00100000:3.0:1781281093.731778:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.733157:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16260 00000100:00100000:2.0:1781281093.733163:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d03547c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12455:x1867808064743808:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.733204:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.733221:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000085e0f1d3/0xce40b48e7cd18186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c075f4 expref: 576 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733238:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f69d6cd6/0xce40b48e7cd0438b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x202:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ea6 expref: 575 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733250:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d19222bb/0xce40b48e7cd04399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x202:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ead expref: 574 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733261:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd0013c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x202:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5c4 expref: 573 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733268:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x202:0x0].0x0 (000000007a49b75b) 00010000:00010000:2.0:1781281093.733275:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.733291:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733302:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733310:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733322:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x200:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733328:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733333:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733400:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733407:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.733413:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.734075:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].411, 64 off34624 00000040:00080000:2.0:1781281093.734096:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4960, 184 off870928 00010000:00010000:2.0:1781281093.734165:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x202:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734178:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734186:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734194:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734270:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734276:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734341:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.734359:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d03547c2 reply state 000000002e687293 transno 4294975468 ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734403:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734409:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734414:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734419:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000090c9d8d4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.734423:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734430:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734440:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:2.0:1781281093.734444:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.734447:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.734452:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2132f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.734460:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d03547c2 reply state 000000002e687293 transno 4294975468 ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.734595:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d03547c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12455:x1867808064743808:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1429us (6951us total) trans 4294975468 rc 0/0 00000100:00100000:2.0:1781281093.734604:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16260 00000040:00080000:0.0:1781281093.738161:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].412, 64 off34688 00000040:00080000:0.0:1781281093.738187:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4961, 184 off871112 00010000:00010000:0.0:1781281093.738272:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x256:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.738284:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.738293:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.738300:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.738305:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.738316:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742313:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281093.742326:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742339:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043d2c912 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.742343:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742351:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742368:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x202:0x0].0x0 (0000000073d09258) 00010000:00010000:3.0:1781281093.742370:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.742374:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742380:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd21344 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x202:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742399:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.742402:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742407:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.742408:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742414:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742421:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x256:0x0].0x0 (000000008a983cf5) 00010000:00010000:3.0:1781281093.742423:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.742425:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 3/0,0 mode: --/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.742431:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.742433:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.742435:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.742735:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281093.743536:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1781281093.743564:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2134b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.743601:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000734b3914 reply state 000000006ebf390f transno 4294975469 ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743654:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743661:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743667:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743673:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000783f699d already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.743676:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743682:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743694:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:0.0:1781281093.743696:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.743699:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.743704:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2131a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.743712:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000734b3914 reply state 000000006ebf390f transno 4294975469 ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.746617:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000734b3914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12456:x1867808064744064:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 11843us (12025us total) trans 4294975469 rc 0/0 00000100:00100000:0.0:1781281093.746632:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16259 00010000:00010000:2.0:1781281093.750006:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.751177:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.751735:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744320 00000100:00100000:0.0:1781281093.751757:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4669 00000100:00100000:0.0:1781281093.751764:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000317757f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12455:x1867808064744192:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.752011:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000317757f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12455:x1867808064744192:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 247us (9279us total) trans 4294975470 rc 0/0 00000100:00100000:0.0:1781281093.752020:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4669 00000100:00100000:0.0:1781281093.752037:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4670 00000100:00100000:0.0:1781281093.752041:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d27c9c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12456:x1867808064744320:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.752120:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d27c9c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12456:x1867808064744320:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 78us (946us total) trans 4294975471 rc 0/0 00000100:00100000:0.0:1781281093.752126:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4670 00010000:00010000:3.0:1781281093.755346:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.755369:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xbea011c (000000004759d1fd) 00010000:00010000:3.0:1781281093.755372:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.755377:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.755383:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x256:0x0].0x0 (000000008a983cf5) 00010000:00010000:3.0:1781281093.755384:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.759118:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.759183:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.759353:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744448 00000100:00100000:0.0:1781281093.759428:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744576 00000100:00100000:2.0:1781281093.759463:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16261 00000100:00100000:2.0:1781281093.759471:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050e0048f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+578:12456:x1867808064744448:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.759564:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.759597:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a41bef3d/0xce40b48e7cd1fc14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a056 expref: 578 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759620:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd07207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01dda expref: 577 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759629:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f35df57b/0xce40b48e7cd07246 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01def expref: 576 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759644:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd018ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff10 expref: 575 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759653:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23c:0x0].0x0 (00000000d4f02738) 00010000:00010000:2.0:1781281093.759662:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.759696:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759710:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759720:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759736:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x232:0x0].0x1674e29a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759742:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759749:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759875:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759883:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.759889:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.760279:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].413, 64 off34752 00000040:00080000:2.0:1781281093.760299:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4962, 184 off871296 00010000:00010000:2.0:1781281093.760361:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760371:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760379:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760386:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760391:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760397:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760427:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.760446:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000050e0048f reply state 00000000e003d17d transno 4294975472 ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760493:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760498:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760504:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760510:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000090c9d8d4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.760525:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760532:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760573:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:2.0:1781281093.760577:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.760579:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760586:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21352 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x232:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.760595:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000050e0048f reply state 00000000e003d17d transno 4294975472 ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.760675:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050e0048f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12456:x1867808064744448:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1202us (1564us total) trans 4294975472 rc 0/0 00000100:00100000:2.0:1781281093.760684:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16261 00000100:00100000:2.0:1781281093.760713:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16262 00000100:00100000:2.0:1781281093.760718:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078b9f818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12455:x1867808064744576:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.760749:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.760763:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd195d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07c37 expref: 575 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760777:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae458b7d/0xce40b48e7cd0475f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x208:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00fd3 expref: 574 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760787:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0217f7/0xce40b48e7cd047ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x208:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ff6 expref: 573 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760798:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000324f2097/0xce40b48e7cd003b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x208:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ce expref: 572 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760806:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x208:0x0].0x0 (00000000c5861570) 00010000:00010000:2.0:1781281093.760813:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.760828:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760837:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760844:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760857:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x200:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760864:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760870:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760933:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x208:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760941:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.760947:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.761189:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].414, 64 off34816 00000040:00080000:2.0:1781281093.761203:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4963, 176 off871472 00010000:00010000:2.0:1781281093.761243:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761252:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761259:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761265:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761269:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761274:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761286:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:2.0:1781281093.761297:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000078b9f818 reply state 000000005e0b1b7c transno 4294975473 ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761331:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761336:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761341:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761346:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081ef8057 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.761349:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761354:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761362:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:2.0:1781281093.761365:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.761367:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.761372:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2136e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.761386:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000078b9f818 reply state 000000005e0b1b7c transno 4294975473 ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.761425:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078b9f818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12455:x1867808064744576:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 706us (2241us total) trans 4294975473 rc 0/0 00000100:00100000:2.0:1781281093.761432:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16262 00010000:00010000:3.0:1781281093.761528:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281093.761533:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761539:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b83e432 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.761565:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761572:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761581:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23c:0x0].0x0 (00000000990336ae) 00010000:00010000:3.0:1781281093.761583:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.761585:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761590:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21367 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761604:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.761606:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761611:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006092e5fa already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.761613:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761618:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761624:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x208:0x0].0x0 (00000000a6f18b60) 00010000:00010000:3.0:1781281093.761626:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.761627:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761632:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd21383 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.761640:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.761641:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.761642:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.761649:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.769288:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.769313:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.769347:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744704 00000100:00100000:3.0:1781281093.769388:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744768 00000100:00100000:3.0:1781281093.769405:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4671 00000100:00100000:3.0:1781281093.769411:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12455:x1867808064744704:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.769693:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12455:x1867808064744704:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 281us (413us total) trans 4294975474 rc 0/0 00000100:00100000:3.0:1781281093.769701:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4671 00000100:00100000:3.0:1781281093.769721:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4672 00000100:00100000:3.0:1781281093.769725:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12456:x1867808064744768:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:3.0:1781281093.770486:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.770645:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.770799:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.770815:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x469e1765 (000000002615b5c4) 00010000:00010000:2.0:1781281093.770818:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.770824:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.770829:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x208:0x0].0x0 (00000000a6f18b60) 00010000:00010000:2.0:1781281093.770831:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.770853:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744832 00000100:00100000:2.0:1781281093.770884:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064744896 00000100:00100000:2.0:1781281093.770902:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16263 00000100:00100000:2.0:1781281093.770907:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ceaec16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+577:2269:x1867808064744832:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:2.0:1781281093.770919:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281093.770938:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd2138a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6c3 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.770985:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.770997:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771006:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771020:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771027:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771033:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771107:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771116:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771122:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281093.771259:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22a:0x0]: returning size 11264 00000004:00200000:2.0:1781281093.771262:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281093.771287:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771296:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771303:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771310:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771315:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a8e7d44f already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.771318:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771324:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771338:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:2.0:1781281093.771340:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.771343:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771347:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd21391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771357:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771362:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771368:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771372:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d607d92 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.771374:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771379:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771385:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x46e192ec (000000001ca491ee) 00010000:00010000:2.0:1781281093.771387:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.771388:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771396:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771426:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd2138a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6c3 expref: 579 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771437:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6c3 expref: 578 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771444:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:2.0:1781281093.771445:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281093.771447:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006092e5fa, rc 0) 00000100:00100000:2.0:1781281093.771486:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ceaec16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+578:2269:x1867808064744832:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 579us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.771493:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16263 00000100:00100000:2.0:1781281093.771538:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16264 00000100:00100000:2.0:1781281093.771570:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b4c77bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+577:2269:x1867808064744896:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:2.0:1781281093.771579:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281093.771586:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6ca expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771610:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771618:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771628:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771639:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771645:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771650:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771701:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771710:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771717:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281093.771847:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1ff:0x0]: returning size 11264 00000004:00200000:2.0:1781281093.771851:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281093.771867:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771875:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771880:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771886:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771890:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043d2c912 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.771893:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771898:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771906:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:2.0:1781281093.771908:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.771910:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771915:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771924:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771929:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771934:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771939:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f5a1775 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.771941:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771946:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771953:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xddbda88f (000000004f6886fa) 00010000:00010000:2.0:1781281093.771955:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.771956:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771961:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771980:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 579 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771989:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 578 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.771994:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:2.0:1781281093.771996:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281093.771998:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d0d9c9e1, rc 0) 00000100:00100000:2.0:1781281093.772019:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b4c77bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+578:2269:x1867808064744896:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 450us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.772025:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16264 00000100:00100000:2.0:1781281093.775844:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.777036:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12456:x1867808064744768:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 7305us (7718us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.777054:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4672 00000100:00100000:2.0:1781281093.785136:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.785180:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.785287:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745152 00000100:00100000:0.0:1781281093.785341:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4673 00000100:00100000:0.0:1781281093.785347:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d040174 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12456:x1867808064745152:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.785602:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d040174 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12456:x1867808064745152:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 253us (474us total) trans 4294975476 rc 0/0 00000100:00100000:0.0:1781281093.785610:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4673 00000100:00100000:3.0:1781281093.786232:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745216 00000100:00100000:3.0:1781281093.786273:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16266 00000100:00100000:3.0:1781281093.786278:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000243992c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12533:x1867808064745216:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:3.0:1781281093.786290:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281093.786307:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6d1 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.786336:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 576 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.786348:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 576 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.786354:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (0000000059c32305) 00010000:00010000:3.0:1781281093.786356:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.786359:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006f8b8042, rc 0) 00000100:00100000:3.0:1781281093.786391:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000243992c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12533:x1867808064745216:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 112us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.786400:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16266 00000100:00100000:2.0:1781281093.792971:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.793084:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745408 00000100:00100000:0.0:1781281093.793143:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4674 00000100:00100000:0.0:1781281093.793149:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df937771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+576:12533:x1867808064745408:12345-192.168.202.40@tcp:37:ll_sa_12456.0 00000100:00100000:2.0:1781281093.797674:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.797774:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745536 00000100:00100000:3.0:1781281093.797841:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16267 00000100:00100000:3.0:1781281093.797846:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db9e7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+578:12456:x1867808064745536:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.797899:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281093.797926:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002cf1109f/0xce40b48e7cd0b869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0366f expref: 578 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.797947:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000175df8e1/0xce40b48e7cd02626 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004c7 expref: 577 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.797959:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d791934f/0xce40b48e7cd0b8d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c036a0 expref: 576 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.797970:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f4eb610/0xce40b48e7cd02611 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004b9 expref: 575 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.797980:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25e:0x0].0x0 (000000004530a32e) 00010000:00010000:3.0:1781281093.797995:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032c4facf/0xce40b48e7cd20e4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a684 expref: 574 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.798001:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (0000000059c32305) 00010000:00010000:3.0:1781281093.798004:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.798031:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.798044:0:15255:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 573 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.798051:0:15255:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.798083:0:15255:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 573 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.798094:0:15255:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 573 pid: 8297 timeout: 716 lvb_type: 0 00000100:00100000:3.0:1781281093.798107:0:15255:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f63b7c9 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083777216:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281093.798182:0:15255:0:(client.c:2500:ptlrpc_set_wait()) set 000000002f8653a2 going to sleep for 43 seconds 00000100:00100000:0.0:1781281093.799441:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df937771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+572:12533:x1867808064745408:12345-192.168.202.40@tcp:37:ll_sa_12456.0 Request processed in 6287us (6474us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.799454:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4674 00000100:00100000:2.0:1781281093.803853:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.804181:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745344 00000100:00100000:0.0:1781281093.804246:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4675 00000100:00100000:0.0:1781281093.804252:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e79b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+572:12455:x1867808064745344:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.804468:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e79b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12455:x1867808064745344:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 215us (623us total) trans 4294975477 rc 0/0 00000100:00100000:0.0:1781281093.804476:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4675 00000100:00100000:3.0:1781281093.804686:0:15255:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f63b7c9 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083777216:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281093.804713:0:15255:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.807146:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745664 00000100:00100000:2.0:1781281093.807194:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16268 00000100:00100000:2.0:1781281093.807208:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035a4c194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12455:x1867808064745664:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.807264:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.807288:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd185ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07728 expref: 573 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807306:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd0442c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x204:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ed7 expref: 572 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807317:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000160c871b/0xce40b48e7cd04456 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x204:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ee5 expref: 571 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807329:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd00207 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x204:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff618 expref: 570 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807336:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x204:0x0].0x0 (00000000e662b1dc) 00010000:00010000:2.0:1781281093.807345:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.807374:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807387:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807396:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807415:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807421:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807426:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807533:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807565:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.807572:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.807940:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].416, 64 off34944 00000040:00080000:2.0:1781281093.807962:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4965, 176 off871832 00010000:00010000:2.0:1781281093.808020:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808030:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808039:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808051:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808057:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808063:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808088:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.808106:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000035a4c194 reply state 000000008a472898 transno 4294975478 ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808156:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808162:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808168:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808174:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b83e432 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.808177:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808183:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808196:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:2.0:1781281093.808199:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.808202:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.808207:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd213ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.808215:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000035a4c194 reply state 000000008a472898 transno 4294975478 ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.808298:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035a4c194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+571:12455:x1867808064745664:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1088us (1361us total) trans 4294975478 rc 0/0 00000100:00100000:2.0:1781281093.808306:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16268 00010000:00010000:3.0:1781281093.808468:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.808473:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.808480:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069d40fbf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.808483:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.808489:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.808498:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x204:0x0].0x0 (000000001ca491ee) 00010000:00010000:3.0:1781281093.808501:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.808503:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.808508:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21401 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.808529:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.808531:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.808532:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.811597:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281093.811836:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.811851:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xe5dc7a0b (000000004f6886fa) 00010000:00010000:3.0:1781281093.811854:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.811859:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.811864:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x204:0x0].0x0 (000000001ca491ee) 00010000:00010000:3.0:1781281093.811866:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.812053:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745728 00010000:00010000:0.0:1781281093.812085:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 571 pid: 8297 timeout: 716 lvb_type: 0 00000100:00100000:0.0:1781281093.812124:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4779 00000100:00100000:0.0:1781281093.812131:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3a9c7f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+571:2270:x1867808064745728:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1781281093.812145:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281093.812151:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 571 pid: 8297 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.812162:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 571 pid: 8297 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.812179:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd213de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d1 expref: 571 pid: 8297 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281093.812191:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (0000000059c32305) 00010000:00010000:0.0:1781281093.812194:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.812214:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.812221:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.812251:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281093.812294:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3a9c7f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+570:2270:x1867808064745728:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 162us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.812301:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4779 00010000:00010000:2.0:1781281093.813708:0:15255:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813724:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813752:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813763:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813774:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813910:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813918:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.813924:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.814946:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].400, 64 off33792 00000040:00080000:2.0:1781281093.814974:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4966, 184 off872016 00010000:00010000:2.0:1781281093.815044:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815058:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815067:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815073:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815079:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815084:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815112:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.815132:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004db9e7bb reply state 000000003412f533 transno 4294975479 ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815180:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815187:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815193:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815345:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.815350:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815358:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081ef8057 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.815362:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815370:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815387:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25e:0x0].0x0 (00000000ef36d1c8) 00010000:00010000:3.0:1781281093.815389:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.815392:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815398:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21416 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.815417:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.815418:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.815420:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.815444:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f9e3574b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.815448:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815454:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815463:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (0000000059c32305) 00010000:00010000:2.0:1781281093.815465:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.815466:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.815472:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd213e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x25d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.815482:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004db9e7bb reply state 000000003412f533 transno 4294975479 ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.815915:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db9e7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+571:12456:x1867808064745536:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 18064us (18246us total) trans 4294975479 rc 0/0 00000100:00100000:2.0:1781281093.815926:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16267 00000100:00100000:2.0:1781281093.820726:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281093.820928:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.820944:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0xdde1c156 (00000000be12aa82) 00010000:00010000:3.0:1781281093.820946:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.820950:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.820955:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25e:0x0].0x0 (00000000ef36d1c8) 00010000:00010000:3.0:1781281093.820957:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.826190:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.826240:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.826271:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.826298:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.826331:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745984 00000100:00100000:2.0:1781281093.826373:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746112 00000100:00100000:2.0:1781281093.826385:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746048 00000100:00100000:2.0:1781281093.826401:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16269 00000100:00100000:2.0:1781281093.826408:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0664d22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+574:2269:x1867808064745984:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:2.0:1781281093.826432:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281093.826455:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2141d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6d8 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826533:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826575:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826587:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826603:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826610:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826617:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826714:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21432 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x222:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826722:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.826728:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.827927:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064745920 00000100:00100000:0.0:1781281093.827963:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4677 00000100:00100000:0.0:1781281093.827967:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12456:x1867808064745920:12345-192.168.202.40@tcp:37:dbench.0 00000004:00200000:2.0:1781281093.829417:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x222:0x0]: returning size 11264 00000004:00200000:2.0:1781281093.829421:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281093.829448:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829458:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829464:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829469:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829474:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000090c9d8d4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.829476:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829482:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829491:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:2.0:1781281093.829493:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.829495:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829501:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd21424 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829520:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829526:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829532:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829536:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081ef8057 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.829538:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829559:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829567:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xf17aab4e (000000007a61c3bd) 00010000:00010000:2.0:1781281093.829574:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.829576:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829581:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd2142b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829612:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2141d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d8 expref: 578 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829623:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000069d40fbf/0xce40b48e7cd21432 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6d8 expref: 577 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.829629:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:2.0:1781281093.829631:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281093.829632:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000069d40fbf, rc 0) 00000100:00100000:2.0:1781281093.829660:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0664d22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+577:2269:x1867808064745984:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 3251us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.829667:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16269 00000100:00100000:2.0:1781281093.831925:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.832022:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746240 00000100:00100000:3.0:1781281093.832074:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16272 00000100:00100000:3.0:1781281093.832081:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+577:12455:x1867808064746240:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.832134:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.832160:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd19f9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07f5c expref: 577 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832183:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004192132f/0xce40b48e7cd0499d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01090 expref: 576 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832196:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd049dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c010ac expref: 575 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832221:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd004a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff729 expref: 574 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832239:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20b:0x0].0x0 (0000000016e87ae1) 00010000:00010000:3.0:1781281093.832247:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.832276:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832290:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832298:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832310:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832316:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832322:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832446:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832454:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.832460:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.832966:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].417, 64 off35008 00000040:00080000:3.0:1781281093.832988:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4967, 184 off872200 00010000:00010000:3.0:1781281093.833047:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833057:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833065:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833072:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833078:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833084:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21486 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833154:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.833174:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000024d058b5 reply state 0000000048fe633a transno 4294975481 ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833219:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833226:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833232:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833239:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f9e3574b already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.833242:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833249:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833259:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:3.0:1781281093.833262:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.833265:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.833270:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21471 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.833278:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000024d058b5 reply state 0000000048fe633a transno 4294975481 ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.833406:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+575:12455:x1867808064746240:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1323us (1486us total) trans 4294975481 rc 0/0 00000100:00100000:3.0:1781281093.833415:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16272 00010000:00010000:0.0:1781281093.834559:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.834561:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.834563:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.835654:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12456:x1867808064745920:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 7681us (9467us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.835666:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4677 00000100:00100000:0.0:1781281093.840810:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.840886:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746368 00000100:00100000:2.0:1781281093.840935:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4678 00000100:00100000:2.0:1781281093.840941:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062b4c9f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12455:x1867808064746368:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.841150:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062b4c9f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12455:x1867808064746368:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 208us (347us total) trans 4294975482 rc 0/0 00000100:00100000:2.0:1781281093.841158:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4678 00010000:00010000:3.0:1781281093.843015:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.843033:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xc3d50206 (0000000050f37f98) 00010000:00010000:3.0:1781281093.843036:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.843040:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.843045:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20b:0x0].0x0 (000000005ec30d0c) 00010000:00010000:3.0:1781281093.843047:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.848106:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.848434:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.848896:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746624 00000100:00100000:2.0:1781281093.848952:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16273 00000100:00100000:2.0:1781281093.848960:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bea495a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12455:x1867808064746624:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.849013:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.849038:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd1cecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x379:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f70 expref: 574 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849059:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd1a61c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x379:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0817e expref: 573 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849070:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd1cee8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x379:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f7e expref: 572 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849083:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9747db6/0xce40b48e7cd1a2f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x379:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0807b expref: 571 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849092:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x379:0x0].0x0 (00000000c8b93baa) 00010000:00010000:2.0:1781281093.849100:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.849130:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849144:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849154:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849168:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849174:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849180:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849289:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x379:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849297:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849304:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.849891:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].401, 64 off33856 00000040:00080000:2.0:1781281093.849913:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4968, 184 off872384 00010000:00010000:2.0:1781281093.849972:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x379:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849981:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x379:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849989:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x379:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.849996:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x379:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850002:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x379:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850010:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x379:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850030:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.850046:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008bea495a reply state 00000000b6fea331 transno 4294975483 ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850088:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850094:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850099:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850104:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b83e432 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.850108:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850115:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850123:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:2.0:1781281093.850126:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.850129:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.850134:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd2148d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x200:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.850142:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008bea495a reply state 00000000b6fea331 transno 4294975483 ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.850394:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bea495a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+572:12455:x1867808064746624:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1432us (1959us total) trans 4294975483 rc 0/0 00000100:00100000:2.0:1781281093.850403:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16273 00000100:00100000:0.0:1781281093.850481:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746496 00000100:00100000:2.0:1781281093.850883:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4679 00000100:00100000:2.0:1781281093.850888:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+572:12456:x1867808064746496:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.851022:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12456:x1867808064746496:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 133us (2926us total) trans 4294975484 rc 0/0 00000100:00100000:2.0:1781281093.851029:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4679 00000100:00100000:2.0:1781281093.854365:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.854455:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746752 00000100:00100000:0.0:1781281093.854521:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16274 00000100:00100000:0.0:1781281093.854527:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df937771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12456:x1867808064746752:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.854609:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281093.854634:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c58dcc82/0xce40b48e7cd128d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05c55 expref: 573 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854658:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd059fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x220:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c015e5 expref: 572 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854672:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd05a7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x220:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01616 expref: 571 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854684:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071e23ee6/0xce40b48e7cd00d21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x220:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffaa2 expref: 570 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854694:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x220:0x0].0x0 (00000000ecaa9965) 00010000:00010000:0.0:1781281093.854710:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009659b7c9/0xce40b48e7cd20e66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a68b expref: 569 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854721:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:0.0:1781281093.854725:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.854755:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854770:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854779:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854795:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854816:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854822:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854931:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x220:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854940:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.854947:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.855360:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].418, 64 off35072 00000040:00080000:0.0:1781281093.855382:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4969, 184 off872568 00010000:00010000:0.0:1781281093.855450:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855465:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855473:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855480:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855486:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855492:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855524:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.855567:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df937771 reply state 0000000083ee7a9f transno 4294975485 ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855614:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855620:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855626:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855632:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.855635:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855642:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855651:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:0.0:1781281093.855653:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.855657:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.855662:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.855670:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df937771 reply state 0000000083ee7a9f transno 4294975485 ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.855742:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df937771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+570:12456:x1867808064746752:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1214us (1385us total) trans 4294975485 rc 0/0 00000100:00100000:0.0:1781281093.855751:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16274 00010000:00010000:3.0:1781281093.856454:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.856467:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xe7aaf970 (000000007a61c3bd) 00010000:00010000:3.0:1781281093.856470:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.856473:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.856479:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x379:0x0].0x0 (00000000b4bdc372) 00010000:00010000:3.0:1781281093.856482:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.857414:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.857453:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.857526:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064746880 00000100:00100000:0.0:1781281093.857588:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4680 00000100:00100000:0.0:1781281093.857594:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+570:12455:x1867808064746880:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.857991:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+571:12455:x1867808064746880:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 396us (579us total) trans 4294975486 rc 0/0 00000100:00100000:0.0:1781281093.857999:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4680 00010000:00010000:3.0:1781281093.860146:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.860170:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xcbe2ca0f (0000000050c21257) 00010000:00010000:3.0:1781281093.860174:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.860178:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.860184:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x220:0x0].0x0 (00000000df751442) 00010000:00010000:3.0:1781281093.860186:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.863869:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.863945:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.864019:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.864090:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747200 00000100:00100000:3.0:1781281093.864140:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747264 00000100:00100000:3.0:1781281093.864160:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4681 00000100:00100000:3.0:1781281093.864165:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3dbdb4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12456:x1867808064747200:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.864403:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3dbdb4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+574:12456:x1867808064747200:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 236us (458us total) trans 4294975487 rc 0/0 00000100:00100000:3.0:1781281093.864412:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4681 00000100:00100000:3.0:1781281093.864432:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4682 00000100:00100000:3.0:1781281093.864436:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+573:12537:x1867808064747264:12345-192.168.202.40@tcp:37:ll_sa_12455.0 00000100:00100000:0.0:1781281093.869965:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+569:12537:x1867808064747264:12345-192.168.202.40@tcp:37:ll_sa_12455.0 Request processed in 5522us (5940us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281093.869982:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4682 00000100:00100000:2.0:1781281093.870537:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.870700:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747392 00000100:00100000:0.0:1781281093.870743:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16277 00000100:00100000:0.0:1781281093.870749:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d27c9c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+569:12456:x1867808064747392:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.870899:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.870931:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd12911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05c6a expref: 569 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.870954:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087cd2332/0xce40b48e7cd056bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c014e9 expref: 568 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.870967:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd056e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c014f7 expref: 567 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.870977:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad627fb1/0xce40b48e7cd00ba7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa01 expref: 566 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.870987:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21c:0x0].0x0 (00000000c3728c87) 00010000:00010000:0.0:1781281093.870995:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.871024:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871038:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871050:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871070:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871076:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871081:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871187:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871275:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871284:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.871877:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].419, 64 off35136 00000040:00080000:0.0:1781281093.871902:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4970, 184 off872752 00010000:00010000:0.0:1781281093.871968:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871979:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871987:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.871998:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872003:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872008:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872068:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.872086:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d27c9c17 reply state 00000000ffe43ad7 transno 4294975488 ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872131:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872137:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872143:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872148:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.872151:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872158:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872172:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:0.0:1781281093.872175:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.872178:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.872184:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd214d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.872193:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d27c9c17 reply state 00000000ffe43ad7 transno 4294975488 ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.872345:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d27c9c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12456:x1867808064747392:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1594us (1809us total) trans 4294975488 rc 0/0 00000100:00100000:0.0:1781281093.872353:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16277 00010000:00010000:3.0:1781281093.874411:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.874432:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x10cfb8f0 (00000000d346c251) 00010000:00010000:3.0:1781281093.874435:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.874444:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.874449:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21c:0x0].0x0 (0000000081cd5431) 00010000:00010000:3.0:1781281093.874451:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281093.874537:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.874563:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.874571:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aaa5c9f9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.874574:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.874581:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.874594:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21c:0x0].0x0 (0000000081cd5431) 00010000:00010000:2.0:1781281093.874596:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.874598:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.874602:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd214e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.874616:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.874617:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.874618:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.876486:0:6155:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f96cbec3 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6155:1867808083777280:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281093.876529:0:6155:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.877266:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.878053:0:6155:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878063:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878087:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878097:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878104:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878221:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x267:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878234:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878240:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281093.878710:0:6155:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x267:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1781281093.878764:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4971, 184 off872936 00000004:00010000:2.0:1781281093.878967:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7e79b84 reply state 00000000fc525f1e transno 4294975489 ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878979:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878985:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878991:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.878997:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005b955b3b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.879000:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.879006:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.879016:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000a362d105) 00010000:00010000:2.0:1781281093.879019:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.879022:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.879027:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd214cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.879036:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7e79b84 reply state 00000000fc525f1e transno 4294975489 ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.879121:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e79b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12455:x1867808064747072:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 11968us (15262us total) trans 4294975489 rc 0/0 00000100:00100000:2.0:1781281093.879130:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16276 00010000:00010000:3.0:1781281093.882008:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.882029:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x8b6dba3a (00000000c5861570) 00010000:00010000:3.0:1781281093.882032:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.882036:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.882043:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x267:0x0].0x0 (00000000eee8b9d0) 00010000:00010000:3.0:1781281093.882045:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.882398:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.882473:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747584 00000100:00100000:0.0:1781281093.882578:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4683 00000100:00100000:0.0:1781281093.882584:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12456:x1867808064747584:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.882825:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+568:12456:x1867808064747584:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 241us (431us total) trans 4294975490 rc 0/0 00000100:00100000:0.0:1781281093.882832:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4683 00000100:00100000:0.0:1781281093.886898:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.886992:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.887080:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747840 00000100:00100000:3.0:1781281093.887123:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4684 00000100:00100000:3.0:1781281093.887129:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005764f9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+568:12455:x1867808064747840:12345-192.168.202.40@tcp:35:dbench.0 00000001:00080000:3.0:1781281093.887468:0:6159:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 4294975491 00000100:00100000:3.0:1781281093.887616:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005764f9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+569:12455:x1867808064747840:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 485us (622us total) trans 4294975491 rc 0/0 00000100:00100000:3.0:1781281093.887624:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4684 00000100:00100000:2.0:1781281093.888445:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747712 00000100:00100000:2.0:1781281093.888562:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16278 00000100:00100000:2.0:1781281093.888567:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091f3bea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+569:12456:x1867808064747712:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.888605:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.888629:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000864e059b/0xce40b48e7cd123f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05abf expref: 569 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888652:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6244a7f/0xce40b48e7cd053de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c013fb expref: 568 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888664:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd0547f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x218:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01425 expref: 567 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888676:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd00a42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x218:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff96e expref: 566 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888685:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x218:0x0].0x0 (00000000a86c7917) 00010000:00010000:2.0:1781281093.888694:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.888720:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888734:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888745:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888760:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888766:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888772:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888876:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x218:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888885:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.888891:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.889208:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].420, 64 off35200 00000040:00080000:2.0:1781281093.889231:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4972, 184 off873120 00010000:00010000:2.0:1781281093.889287:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889297:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889305:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889312:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889318:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889324:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd21512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889349:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.889364:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000091f3bea8 reply state 00000000d467461b transno 4294975492 ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889414:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889420:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889426:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889432:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceac6799 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.889435:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889442:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889450:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.889453:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.889456:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.889460:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd214fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.889469:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000091f3bea8 reply state 00000000d467461b transno 4294975492 ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.889567:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091f3bea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12456:x1867808064747712:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 998us (2680us total) trans 4294975492 rc 0/0 00000100:00100000:2.0:1781281093.889576:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16278 00010000:00010000:3.0:1781281093.891509:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.891534:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x801dd473 (000000009bddd47c) 00010000:00010000:3.0:1781281093.891536:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.891578:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.891586:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x218:0x0].0x0 (0000000079049e0c) 00010000:00010000:3.0:1781281093.891588:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.891747:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064747968 00000100:00100000:0.0:1781281093.891807:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16279 00000100:00100000:0.0:1781281093.891813:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cc2f86a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12455:x1867808064747968:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.891857:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281093.891877:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af9e08b/0xce40b48e7cd20b3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5c7 expref: 567 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891895:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e197df55/0xce40b48e7cd0be97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x268:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c038ad expref: 566 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891905:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd0bf1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x268:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c038e5 expref: 565 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891915:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce2348b7/0xce40b48e7cd02a32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x268:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00648 expref: 564 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891923:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000afec688e) 00010000:00010000:0.0:1781281093.891930:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.891956:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891969:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891979:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891993:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.891998:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892004:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892092:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x268:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892100:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892107:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1781281093.892416:0:15255:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x268:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1781281093.892465:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4973, 184 off873304 00000004:00010000:0.0:1781281093.892575:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007cc2f86a reply state 00000000d5b172ac transno 4294975493 ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892588:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892594:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892605:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892615:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.892618:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892624:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892633:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000a362d105) 00010000:00010000:0.0:1781281093.892635:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.892638:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.892643:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21519 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.892653:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007cc2f86a reply state 00000000d5b172ac transno 4294975493 ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.892719:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cc2f86a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+565:12455:x1867808064747968:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 906us (2027us total) trans 4294975493 rc 0/0 00000100:00100000:0.0:1781281093.892727:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16279 00010000:00010000:2.0:1781281093.894228:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.894246:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x8d5ea5b7 (00000000ab645b08) 00010000:00010000:2.0:1781281093.894248:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.894252:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.894257:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000c3728c87) 00010000:00010000:2.0:1781281093.894259:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.896361:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748096 00000100:00100000:0.0:1781281093.896409:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4685 00000100:00100000:0.0:1781281093.896416:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+565:12455:x1867808064748096:12345-192.168.202.40@tcp:35:dbench.0 00000001:00080000:0.0:1781281093.897033:0:6160:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 4294975494 00000100:00100000:0.0:1781281093.897131:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+566:12455:x1867808064748096:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 714us (1382us total) trans 4294975494 rc 0/0 00000100:00100000:0.0:1781281093.897143:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4685 00000100:00100000:2.0:1781281093.899036:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748224 00000100:00100000:2.0:1781281093.899083:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16280 00000100:00100000:2.0:1781281093.899089:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021a13984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+566:12455:x1867808064748224:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.899139:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.899166:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000de15a0e1/0xce40b48e7cd20a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x265:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a588 expref: 566 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899186:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000422a0eb0/0xce40b48e7cd0bcf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x265:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0381a expref: 565 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899209:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd0bd16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x265:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03828 expref: 564 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899219:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058b84cec/0xce40b48e7cd028b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x265:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005a0 expref: 563 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899227:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x265:0x0].0x0 (00000000758c336a) 00010000:00010000:2.0:1781281093.899234:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.899260:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899274:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899285:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899298:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x263:0x0].0xe364b611 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899309:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899315:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899402:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x265:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899408:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899414:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281093.899726:0:6155:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x265:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1781281093.899768:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4974, 184 off873488 00000004:00010000:2.0:1781281093.899833:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000021a13984 reply state 000000009ef621ed transno 4294975495 ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899845:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899851:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899857:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899868:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bedcc5aa already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.899871:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899878:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899886:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000a362d105) 00010000:00010000:2.0:1781281093.899888:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.899890:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.899895:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd2152e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.899905:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000021a13984 reply state 000000009ef621ed transno 4294975495 ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.899976:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021a13984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+564:12455:x1867808064748224:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 886us (1036us total) trans 4294975495 rc 0/0 00000100:00100000:2.0:1781281093.899984:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16280 00010000:00010000:0.0:1781281093.901668:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.901687:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0xe364b611 (000000003ba0ca5b) 00010000:00010000:0.0:1781281093.901690:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.901694:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.901699:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x265:0x0].0x0 (00000000d4f02738) 00010000:00010000:0.0:1781281093.901701:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.903178:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748352 00000100:00100000:0.0:1781281093.903238:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4686 00000100:00100000:0.0:1781281093.903245:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+564:12456:x1867808064748352:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.903469:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+565:12456:x1867808064748352:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 223us (562us total) trans 4294975496 rc 0/0 00000100:00100000:0.0:1781281093.903476:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4686 00000100:00100000:2.0:1781281093.905351:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748416 00000100:00100000:2.0:1781281093.905436:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4687 00000100:00100000:2.0:1781281093.905444:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+565:12455:x1867808064748416:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:3.0:1781281093.907194:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748544 00000100:00100000:3.0:1781281093.907244:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16281 00000100:00100000:3.0:1781281093.907250:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071c698b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+567:12456:x1867808064748544:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.907295:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.907318:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5ba94c1/0xce40b48e7cd1238b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05a95 expref: 567 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907339:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd051d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x216:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0135a expref: 566 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907352:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd0524f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x216:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0137d expref: 565 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907361:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e70e2ff/0xce40b48e7cd0095b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x216:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff90c expref: 564 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907370:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x216:0x0].0x0 (000000000fe3bb58) 00010000:00010000:3.0:1781281093.907378:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.907406:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907419:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907429:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907444:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907451:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907457:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907586:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x216:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907595:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.907601:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.907963:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].421, 64 off35264 00000040:00080000:3.0:1781281093.907983:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4975, 184 off873672 00010000:00010000:3.0:1781281093.908040:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x216:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908049:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908056:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908068:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908073:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908078:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd21558 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908093:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.908110:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071c698b9 reply state 000000003edf4901 transno 4294975497 ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908155:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908161:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908166:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908171:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f9e3574b already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.908174:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908182:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908194:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:3.0:1781281093.908197:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.908200:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.908205:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd21543 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.908212:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071c698b9 reply state 000000003edf4901 transno 4294975497 ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.908281:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071c698b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+565:12456:x1867808064748544:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1029us (1440us total) trans 4294975497 rc 0/0 00000100:00100000:3.0:1781281093.908289:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16281 00010000:00010000:2.0:1781281093.911303:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.911327:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x1e0192a5 (00000000e894a040) 00010000:00010000:2.0:1781281093.911330:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.911335:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.911341:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x216:0x0].0x0 (00000000661a8a60) 00010000:00010000:2.0:1781281093.911343:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.912449:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+563:12455:x1867808064748416:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 7002us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.912463:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4687 00000100:00100000:3.0:1781281093.913445:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064748672 00000100:00100000:3.0:1781281093.913486:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4688 00000100:00100000:3.0:1781281093.913492:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+563:12456:x1867808064748672:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.913734:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+564:12456:x1867808064748672:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 241us (2038us total) trans 4294975498 rc 0/0 00000100:00100000:3.0:1781281093.913741:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4688 00000100:00100000:2.0:1781281093.915399:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.916007:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16282 00000100:00100000:2.0:1781281093.916014:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+564:12456:x1867808064748800:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.916063:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.916090:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032a16806/0xce40b48e7cd12b87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05d4a expref: 564 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916113:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd057e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01544 expref: 563 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916126:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d14dfb96/0xce40b48e7cd05845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01567 expref: 562 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916139:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd00c6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa5c expref: 561 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916149:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21e:0x0].0x0 (00000000baa0939e) 00010000:00010000:2.0:1781281093.916158:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.916186:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916218:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916228:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916242:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916248:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916253:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916354:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916362:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.916370:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.917021:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].422, 64 off35328 00000040:00080000:2.0:1781281093.917044:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4976, 176 off873848 00010000:00010000:2.0:1781281093.917106:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917115:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917124:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917131:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917137:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917143:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917215:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.917235:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000065093734 reply state 0000000012dd2e82 transno 4294975499 ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917282:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917289:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917295:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917301:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b75f790e already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.917304:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917316:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917325:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.917328:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.917331:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.917336:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2155f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.917344:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000065093734 reply state 0000000012dd2e82 transno 4294975499 ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.917458:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+562:12456:x1867808064748800:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1442us (2062us total) trans 4294975499 rc 0/0 00000100:00100000:2.0:1781281093.917467:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16282 00010000:00010000:0.0:1781281093.920787:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281093.920793:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.920809:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008e62497b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281093.920812:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.920819:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.920836:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21e:0x0].0x0 (000000006d773b06) 00010000:00010000:0.0:1781281093.920838:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281093.920841:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.920846:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd21574 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.920860:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.920861:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.920862:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.925176:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.928087:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.928351:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.928443:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749184 00000100:00100000:2.0:1781281093.928504:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16283 00000100:00100000:2.0:1781281093.928520:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+563:12456:x1867808064749184:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.928695:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.928724:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd12ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05ed2 expref: 563 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928745:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd04a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c010e4 expref: 562 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928762:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b17d08d8/0xce40b48e7cd04ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01100 expref: 561 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928774:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009df5d7e9/0xce40b48e7cd00548 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff768 expref: 560 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928783:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20c:0x0].0x0 (000000002fb6f147) 00010000:00010000:2.0:1781281093.928792:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.928828:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928843:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928852:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928864:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928870:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928875:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928964:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928977:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.928983:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.929317:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].402, 64 off33920 00000040:00080000:2.0:1781281093.929337:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4977, 184 off874032 00010000:00010000:2.0:1781281093.929396:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929406:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929414:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929421:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929427:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929433:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929523:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.929571:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f63b7c9 reply state 000000004d76c534 transno 4294975501 ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929622:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929629:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929635:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929640:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b75f790e already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.929644:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929650:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929660:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.929663:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.929666:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.929671:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd2157b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.929679:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f63b7c9 reply state 000000004d76c534 transno 4294975501 ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.929765:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+561:12456:x1867808064749184:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1253us (1414us total) trans 4294975501 rc 0/0 00000100:00100000:2.0:1781281093.929774:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16283 00010000:00010000:3.0:1781281093.930290:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.930296:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.930304:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e05f645 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.930307:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.930313:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.930324:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20c:0x0].0x0 (000000000a0092e4) 00010000:00010000:3.0:1781281093.930326:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.930329:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.930334:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd21590 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.930345:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.930346:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.930348:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.932116:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.932135:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xbfd87aeb (00000000cbb1a944) 00010000:00010000:2.0:1781281093.932138:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.932142:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.932148:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20c:0x0].0x0 (000000000a0092e4) 00010000:00010000:2.0:1781281093.932150:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.936177:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.936286:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.936486:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749440 00000100:00100000:0.0:1781281093.936582:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16284 00000100:00100000:0.0:1781281093.936588:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+562:12455:x1867808064749440:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.936645:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281093.936672:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c478a1ac/0xce40b48e7cd0605d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x227:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01807 expref: 562 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936695:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd0100e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbc1 expref: 561 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936709:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000766ba59c/0xce40b48e7cd060a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x227:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0181c expref: 560 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936720:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd331361/0xce40b48e7cd00ff9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x227:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbb3 expref: 559 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936735:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x227:0x0].0x0 (00000000dbeee980) 00010000:00010000:0.0:1781281093.936748:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000467f022c/0xce40b48e7cd20f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a699 expref: 558 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936753:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:0.0:1781281093.936755:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.936781:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936791:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936807:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936817:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x225:0x0].0xeff62052 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936822:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936825:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936903:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936907:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.936912:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.937163:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].403, 64 off33984 00000040:00080000:0.0:1781281093.937177:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4978, 184 off874216 00010000:00010000:0.0:1781281093.937221:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937228:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937233:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937238:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937242:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937245:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd215ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937254:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.937268:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000feb74d6 reply state 0000000007dd65dc transno 4294975503 ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937305:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937310:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937314:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937317:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.937320:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937324:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937329:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:0.0:1781281093.937330:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.937332:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.937335:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21597 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.937341:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000feb74d6 reply state 0000000007dd65dc transno 4294975503 ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.937402:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+559:12455:x1867808064749440:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 814us (1115us total) trans 4294975503 rc 0/0 00000100:00100000:0.0:1781281093.937408:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16284 00000100:00100000:2.0:1781281093.937861:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749312 00000100:00100000:2.0:1781281093.937898:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4691 00000100:00100000:2.0:1781281093.937903:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+559:12456:x1867808064749312:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.938048:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+560:12456:x1867808064749312:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 143us (1876us total) trans 4294975504 rc 0/0 00000100:00100000:2.0:1781281093.938055:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4691 00000100:00100000:0.0:1781281093.939404:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.939460:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749568 00000100:00100000:3.0:1781281093.939501:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16285 00000100:00100000:3.0:1781281093.939506:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000477367a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+560:12456:x1867808064749568:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.939615:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.939637:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aae7c43/0xce40b48e7cd12322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05a72 expref: 560 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939658:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd0503b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x214:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c012c7 expref: 559 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939671:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005e9a6127/0xce40b48e7cd05096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x214:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c012e3 expref: 558 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939683:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9ac0537/0xce40b48e7cd00897 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x214:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b8 expref: 557 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939691:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x214:0x0].0x0 (00000000649ca2ab) 00010000:00010000:3.0:1781281093.939698:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.939723:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939734:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939743:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939754:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939758:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939761:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939836:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x214:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939840:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.939844:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.940089:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].423, 64 off35392 00000040:00080000:3.0:1781281093.940104:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4979, 184 off874400 00010000:00010000:3.0:1781281093.940142:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940148:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940153:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940156:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940160:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940164:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940184:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.940199:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000477367a3 reply state 00000000676c796c transno 4294975505 ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940229:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.940233:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940240:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940240:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.940244:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940245:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940250:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940251:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940255:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000db20456d already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.940257:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940263:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940266:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x214:0x0].0x0 (000000000fe3bb58) 00010000:00010000:2.0:1781281093.940269:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.940270:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.940271:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940272:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.940273:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940276:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd215c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.940279:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db20456d/0xce40b48e7cd215b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.940286:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.940287:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.940288:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1781281093.940294:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000477367a3 reply state 00000000676c796c transno 4294975505 ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.940352:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000477367a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+558:12456:x1867808064749568:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 844us (948us total) trans 4294975505 rc 0/0 00000100:00100000:3.0:1781281093.940359:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16285 00000100:00100000:3.0:1781281093.942123:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.942172:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749696 00000100:00100000:2.0:1781281093.942263:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4692 00000100:00100000:2.0:1781281093.942270:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+558:12455:x1867808064749696:12345-192.168.202.40@tcp:35:dbench.0 00010000:00010000:0.0:1781281093.942304:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.942318:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xd60b5417 (00000000afec688e) 00010000:00010000:0.0:1781281093.942320:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.942324:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.942329:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x214:0x0].0x0 (000000000fe3bb58) 00010000:00010000:0.0:1781281093.942331:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.942485:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+559:12455:x1867808064749696:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 215us (367us total) trans 4294975506 rc 0/0 00000100:00100000:2.0:1781281093.942494:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4692 00000100:00100000:2.0:1781281093.944259:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.944312:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749824 00000100:00100000:0.0:1781281093.944349:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4693 00000100:00100000:0.0:1781281093.944355:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+559:12456:x1867808064749824:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281093.944812:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.944848:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064749952 00000100:00100000:2.0:1781281093.944886:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16286 00000100:00100000:2.0:1781281093.944891:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab39167a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+561:12455:x1867808064749952:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.944926:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.944953:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd0618a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x229:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01877 expref: 561 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.944976:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a4676793/0xce40b48e7cd010fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x229:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc23 expref: 560 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.944990:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000004e09df/0xce40b48e7cd061d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x229:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01885 expref: 559 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945000:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd010e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x229:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc1c expref: 558 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945009:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x229:0x0].0x0 (00000000566a0164) 00010000:00010000:2.0:1781281093.945019:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.945044:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.945054:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+557:12456:x1867808064749824:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 699us (799us total) trans 4294975507 rc 0/0 00010000:00010000:2.0:1781281093.945058:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.945061:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4693 00010000:00010000:2.0:1781281093.945067:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945080:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945087:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945093:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945190:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x229:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945202:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945209:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.945888:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].404, 64 off34048 00000040:00080000:2.0:1781281093.945908:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4980, 184 off874584 00010000:00010000:2.0:1781281093.945951:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x229:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945958:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945963:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945968:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945972:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945975:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.945988:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.946004:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ab39167a reply state 00000000ed50a735 transno 4294975508 ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946011:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.946016:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946022:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000272ebe2e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.946025:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946031:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946041:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x229:0x0].0x0 (00000000081f9a93) 00010000:00010000:3.0:1781281093.946044:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.946046:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946048:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946051:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000272ebe2e/0xce40b48e7cd215e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946055:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946060:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.946061:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.946062:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.946064:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.946065:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b75f790e already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.946067:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946072:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946080:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:2.0:1781281093.946082:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.946084:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.946088:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b75f790e/0xce40b48e7cd215cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x225:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.946094:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ab39167a reply state 00000000ed50a735 transno 4294975508 ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.946132:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab39167a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+558:12455:x1867808064749952:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1241us (1321us total) trans 4294975508 rc 0/0 00000100:00100000:2.0:1781281093.946137:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16286 00000100:00100000:3.0:1781281093.948221:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.948266:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064750080 00000100:00100000:2.0:1781281093.948324:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16287 00000100:00100000:2.0:1781281093.948332:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dde30e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+558:12456:x1867808064750080:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.948386:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.948409:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000973d558/0xce40b48e7cd12487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05af7 expref: 558 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948831:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd055f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c014b1 expref: 557 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948851:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009732178f/0xce40b48e7cd05615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c014bf expref: 556 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948863:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd00ae3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9b4 expref: 555 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948872:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21a:0x0].0x0 (000000001dc229fe) 00010000:00010000:2.0:1781281093.948880:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.948914:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948924:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948930:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948944:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948948:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.948951:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949021:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949025:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949028:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.949304:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].424, 64 off35456 00000040:00080000:2.0:1781281093.949319:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4981, 184 off874768 00010000:00010000:2.0:1781281093.949361:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949367:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949372:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949379:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949383:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949386:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949406:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.949420:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006dde30e3 reply state 0000000039109d34 transno 4294975509 ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.949882:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.949884:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.949885:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.949896:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949903:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949909:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949913:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e05f645 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.949916:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949921:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949933:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.949935:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.949937:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.949943:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e05f645/0xce40b48e7cd215eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.949951:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006dde30e3 reply state 0000000039109d34 transno 4294975509 ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.950039:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dde30e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+556:12456:x1867808064750080:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1706us (1819us total) trans 4294975509 rc 0/0 00000100:00100000:2.0:1781281093.950047:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16287 00000100:00100000:0.0:1781281093.950279:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064750208 00000100:00100000:0.0:1781281093.950360:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4694 00000100:00100000:0.0:1781281093.950365:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+556:12455:x1867808064750208:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.950535:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+557:12455:x1867808064750208:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 167us (297us total) trans 4294975510 rc 0/0 00000100:00100000:0.0:1781281093.950571:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4694 00010000:00010000:2.0:1781281093.952918:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.952940:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xee1a16ec (000000002fb6f147) 00010000:00010000:2.0:1781281093.952943:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.952948:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.952954:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21a:0x0].0x0 (00000000baa0939e) 00010000:00010000:2.0:1781281093.952955:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281093.953297:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281093.954318:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.954323:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2161c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.954334:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000038607c44 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.954337:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2161c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.954344:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2161c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.954353:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22b:0x0].0x0 (00000000d50558db) 00010000:00010000:2.0:1781281093.954355:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.954358:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2161c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.954364:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2161c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.954373:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.954374:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.954375:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281093.956435:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.956498:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064750336 00000100:00100000:2.0:1781281093.956812:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4695 00000100:00100000:2.0:1781281093.956820:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12456:x1867808064750336:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.957053:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+556:12456:x1867808064750336:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 233us (625us total) trans 4294975512 rc 0/0 00000100:00100000:2.0:1781281093.957061:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4695 00000100:00100000:2.0:1781281093.957965:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.959689:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.959733:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064750656 00000100:00100000:2.0:1781281093.959773:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16290 00000100:00100000:2.0:1781281093.959778:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4000542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+558:12456:x1867808064750656:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.959817:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.959832:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed66cd54/0xce40b48e7cd04dcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x210:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01203 expref: 558 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959848:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043819a60/0xce40b48e7cd00747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff825 expref: 557 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959859:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ff76f510/0xce40b48e7cd04e0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x210:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01211 expref: 556 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959868:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8676f08/0xce40b48e7cd00732 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x210:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff81e expref: 556 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959882:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x210:0x0].0x0 (00000000410379d0) 00010000:00010000:2.0:1781281093.959888:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.959907:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959916:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959923:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959935:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959942:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.959948:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960032:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x210:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960042:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960048:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.960415:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].426, 64 off35584 00000040:00080000:2.0:1781281093.960450:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4983, 184 off875136 00010000:00010000:2.0:1781281093.960498:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x210:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960522:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960530:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960537:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960574:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960584:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960664:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281093.960679:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f4000542 reply state 0000000060a7c1db transno 4294975513 ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960717:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960721:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960725:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960728:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003d9d0481 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.960730:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960733:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960739:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:2.0:1781281093.960740:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.960744:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.960747:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd2163f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.960753:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f4000542 reply state 0000000060a7c1db transno 4294975513 ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281093.960831:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4000542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+556:12456:x1867808064750656:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1051us (1142us total) trans 4294975513 rc 0/0 00000100:00100000:2.0:1781281093.960839:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16290 00010000:00010000:3.0:1781281093.961089:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.961095:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.961102:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b5799f48 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.961105:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.961110:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.961119:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x210:0x0].0x0 (00000000ecaa9965) 00010000:00010000:3.0:1781281093.961121:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.961123:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.961129:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21654 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x210:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.961138:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.961139:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.961141:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281093.961207:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3dbdb4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12455:x1867808064750528:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 3117us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281093.961214:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16289 00010000:00010000:2.0:1781281093.962279:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.962294:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x5a3b2e4f (000000001dc229fe) 00010000:00010000:2.0:1781281093.962296:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.962300:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.962306:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x210:0x0].0x0 (00000000ecaa9965) 00010000:00010000:2.0:1781281093.962308:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281093.964474:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.964578:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064750784 00000100:00100000:0.0:1781281093.964619:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.964620:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4696 00000100:00100000:2.0:1781281093.964637:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025b1586f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12456:x1867808064750784:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281093.965083:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025b1586f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+557:12456:x1867808064750784:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 455us (617us total) trans 4294975514 rc 0/0 00000100:00100000:2.0:1781281093.965090:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4696 00000100:00100000:0.0:1781281093.967591:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.967673:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751040 00000100:00100000:3.0:1781281093.967736:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16291 00000100:00100000:3.0:1781281093.967744:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002fe2068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+557:12456:x1867808064751040:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281093.967820:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281093.967851:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005cea0eae/0xce40b48e7cd12e66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c05e4d expref: 557 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967873:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd04c44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01177 expref: 556 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967887:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a20580ac/0xce40b48e7cd04cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0119a expref: 555 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967899:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd00628 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7b5 expref: 554 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967909:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20e:0x0].0x0 (0000000029006562) 00010000:00010000:3.0:1781281093.967919:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281093.967949:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967963:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967972:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967988:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.967995:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968005:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968116:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968124:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968131:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281093.968496:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].427, 64 off35648 00000100:00100000:0.0:1781281093.968564:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000040:00080000:3.0:1781281093.968571:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4984, 184 off875320 00010000:00010000:3.0:1781281093.968637:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968647:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968653:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968661:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968666:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968677:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968690:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281093.968707:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000002fe2068 reply state 00000000f8f2ac38 transno 4294975516 ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968750:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968757:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968763:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968769:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000008eb17f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281093.968772:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968779:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968786:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:3.0:1781281093.968788:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281093.968791:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.968797:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2165b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281093.968805:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000002fe2068 reply state 00000000f8f2ac38 transno 4294975516 ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281093.968875:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002fe2068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+551:12456:x1867808064751040:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1130us (1295us total) trans 4294975516 rc 0/0 00000100:00100000:3.0:1781281093.968881:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16291 00010000:00010000:2.0:1781281093.969323:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281093.969328:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969339:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026f7797d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.969342:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969348:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969357:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20e:0x0].0x0 (00000000410379d0) 00010000:00010000:2.0:1781281093.969359:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.969362:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969367:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21670 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969378:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281093.969379:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd2168c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969385:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceac6799 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281093.969387:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd2168c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969392:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd2168c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969398:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fe:0x0].0x0 (000000002499e313) 00010000:00010000:2.0:1781281093.969400:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281093.969402:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd2168c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969407:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd2168c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.969415:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.969416:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.969417:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281093.969688:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281093.972390:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.972415:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x204a7f30 (0000000027c0c36c) 00010000:00010000:2.0:1781281093.972418:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.972490:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.972499:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fe:0x0].0x0 (000000002499e313) 00010000:00010000:2.0:1781281093.972501:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.975819:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281093.975849:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281093.975915:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751296 00000100:00100000:0.0:1781281093.975964:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751424 00000100:00100000:0.0:1781281093.975987:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4698 00000100:00100000:0.0:1781281093.975993:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+553:12455:x1867808064751296:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281093.976338:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+554:12455:x1867808064751296:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 343us (525us total) trans 4294975518 rc 0/0 00000100:00100000:0.0:1781281093.976346:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4698 00000100:00100000:2.0:1781281093.976748:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e434bf45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+554:12456:x1867808064751424:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 749us (897us total) trans 4294975519 rc 0/0 00000100:00100000:2.0:1781281093.976756:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4699 00000100:00100000:3.0:1781281093.978740:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281093.982815:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751552 00000100:00100000:0.0:1781281093.982835:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751680 00000100:00100000:2.0:1781281093.982882:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16293 00000100:00100000:2.0:1781281093.982893:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12455:x1867808064751552:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281093.982949:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00000100:00100000:0.0:1781281093.982950:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16294 00000100:00100000:0.0:1781281093.982955:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12456:x1867808064751680:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281093.982974:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281093.982976:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd20cad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a63e expref: 555 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.982984:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd120d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x212:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c059a0 expref: 555 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983004:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047a39253/0xce40b48e7cd040cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00daa expref: 553 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983004:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd04eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x212:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0123b expref: 553 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983015:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e571e378/0xce40b48e7cd04193 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00de9 expref: 551 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983017:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b7695d8b/0xce40b48e7cd04f38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x212:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0126c expref: 551 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983026:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7ccffe79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4c1 expref: 549 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983030:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c9b09863/0xce40b48e7cd007d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x212:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff864 expref: 549 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983035:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (0000000028d567f6) 00010000:00010000:0.0:1781281093.983042:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x212:0x0].0x0 (00000000295e57e7) 00010000:00010000:2.0:1781281093.983044:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281093.983047:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281093.983073:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983073:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983087:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983087:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983097:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983097:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983111:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983111:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983118:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983118:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983124:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983124:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983215:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983215:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x212:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983223:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983223:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983230:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983230:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281093.983639:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].429, 64 off35776 00000040:00080000:0.0:1781281093.983661:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4986, 184 off875688 00000004:00080000:2.0:1781281093.983681:0:6155:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x1fc:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1781281093.983718:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x212:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281093.983719:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4987, 184 off875872 00010000:00010000:0.0:1781281093.983727:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983735:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983742:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983748:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983753:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.983773:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000876fffde reply state 0000000056fd9bb4 transno 4294975521 ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983773:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281093.983781:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d98347d5 reply state 000000003a8e0e07 transno 4294975520 ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983783:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983788:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983823:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983829:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983836:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983842:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281093.983846:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983847:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983853:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000040d91bad already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281093.983854:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983854:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983860:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.983863:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:0.0:1781281093.983865:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.983868:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983871:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:2.0:1781281093.983873:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.983873:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd2169a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983875:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.983880:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21693 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281093.983883:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d98347d5 reply state 000000003a8e0e07 transno 4294975520 ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281093.983888:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000876fffde reply state 0000000056fd9bb4 transno 4294975521 ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281093.984335:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+551:12456:x1867808064751680:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1377us (4883us total) trans 4294975520 rc 0/0 00000100:00100000:0.0:1781281093.984343:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16294 00010000:00010000:3.0:1781281093.985134:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281093.985141:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.985151:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aaa5c9f9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281093.985154:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.985161:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.985174:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x212:0x0].0x0 (00000000c6938ba4) 00010000:00010000:3.0:1781281093.985304:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281093.985308:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.985314:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281093.985332:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.985334:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281093.985335:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281093.985628:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+550:12455:x1867808064751552:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2733us (6999us total) trans 4294975521 rc 0/0 00000100:00100000:2.0:1781281093.985637:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16293 00010000:00010000:0.0:1781281093.986285:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.986298:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xc5f130b7 (000000003cfe86b1) 00010000:00010000:0.0:1781281093.986301:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.986304:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.986309:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x212:0x0].0x0 (00000000c6938ba4) 00010000:00010000:0.0:1781281093.986311:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281093.993252:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.993271:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0xf786fdb3 (00000000ce5e61ac) 00010000:00010000:2.0:1781281093.993274:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281093.993279:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281093.993284:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (000000007954595b) 00010000:00010000:2.0:1781281093.993286:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281093.993463:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751744 00000100:00100000:3.0:1781281093.993531:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4700 00000100:00100000:3.0:1781281093.993570:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+550:12455:x1867808064751744:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:0.0:1781281093.999492:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751936 00000100:00100000:0.0:1781281093.999580:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16295 00000100:00100000:0.0:1781281093.999586:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bf22a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+552:12543:x1867808064751936:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:0.0:1781281093.999607:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281093.999640:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x260:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a6fb expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.999678:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 553 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.999693:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 553 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281093.999703:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:0.0:1781281093.999706:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281093.999710:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000362e76ce, rc 0) 00000100:00100000:0.0:1781281093.999772:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bf22a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+553:12543:x1867808064751936:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 185us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281093.999774:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064751872 00000100:00100000:0.0:1781281093.999780:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16295 00000100:00100000:2.0:1781281094.000344:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4701 00000100:00100000:2.0:1781281094.000349:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+552:12456:x1867808064751872:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.001053:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+552:12455:x1867808064751744:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 7512us (7803us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.001062:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4700 00000100:00100000:2.0:1781281094.002922:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+552:12456:x1867808064751872:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 2566us (4611us total) trans 4294975522 rc 0/0 00000100:00100000:2.0:1781281094.002934:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4701 00000100:00100000:2.0:1781281094.004471:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752000 00000100:00100000:2.0:1781281094.004951:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4702 00000100:00100000:2.0:1781281094.004959:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000786bee21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+552:12543:x1867808064752000:12345-192.168.202.40@tcp:37:ll_sa_12456.0 00000100:00100000:3.0:1781281094.010532:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752256 00000100:00100000:3.0:1781281094.010603:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4703 00000100:00100000:3.0:1781281094.010609:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+554:12455:x1867808064752256:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.010828:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+555:12455:x1867808064752256:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 218us (447us total) trans 4294975523 rc 0/0 00000100:00100000:3.0:1781281094.010836:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4703 00000100:00100000:2.0:1781281094.011440:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000786bee21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+553:12543:x1867808064752000:12345-192.168.202.40@tcp:37:ll_sa_12456.0 Request processed in 6482us (7490us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.011449:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4702 00000100:00100000:2.0:1781281094.011521:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752128 00000100:00100000:2.0:1781281094.011568:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752320 00000100:00100000:2.0:1781281094.011595:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16296 00000100:00100000:2.0:1781281094.011600:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eee05b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+554:12456:x1867808064752128:12345-192.168.202.40@tcp:36:dbench.0 00000100:00100000:0.0:1781281094.011611:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16297 00000100:00100000:0.0:1781281094.011616:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+554:12545:x1867808064752320:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:2.0:1781281094.011631:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281094.011634:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281094.011654:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a702 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011655:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd20479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x266:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a382 expref: 554 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011674:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd057157/0xce40b48e7cd0bd47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x266:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03836 expref: 554 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.011680:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 553 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011685:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000280695eb/0xce40b48e7cd0bd6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x266:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03844 expref: 553 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.011691:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 552 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011695:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fe851236/0xce40b48e7cd0296e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x266:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005f4 expref: 552 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.011699:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.011702:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.011705:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aaa5c9f9, rc 0) 00010000:00010000:2.0:1781281094.011708:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x266:0x0].0x0 (000000008937527c) 00010000:00010000:2.0:1781281094.011722:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002c11751d/0xce40b48e7cd0ba06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x260:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03702 expref: 551 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.011727:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+551:12545:x1867808064752320:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 110us (1321us total) trans 0 rc 0/0 00010000:00010000:2.0:1781281094.011731:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:2.0:1781281094.011733:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281094.011733:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16297 00010000:00010000:2.0:1781281094.011756:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011767:0:6157:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 549 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011773:0:6157:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011809:0:6157:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 549 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.011821:0:6157:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 549 pid: 6155 timeout: 716 lvb_type: 0 00000100:00100000:2.0:1781281094.011833:0:6157:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6157:1867808083777344:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281094.011870:0:6157:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d8827c62 going to sleep for 43 seconds 00000100:00100000:2.0:1781281094.016166:0:6157:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6157:1867808083777344:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281094.016218:0:6157:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.018342:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.018590:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752448 00000100:00100000:2.0:1781281094.018647:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16298 00000100:00100000:2.0:1781281094.018654:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+550:12455:x1867808064752448:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.018703:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1781281094.018730:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006b980c9/0xce40b48e7cd200e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a239 expref: 550 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018750:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a166be0f/0xce40b48e7cd1fc84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3a0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a080 expref: 549 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018760:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dc671e4/0xce40b48e7cd1fca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3a0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a08e expref: 548 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018770:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a728c20/0xce40b48e7cd1e117 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3a0:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09631 expref: 547 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018778:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a0:0x0].0x0 (000000001bab2cea) 00010000:00010000:2.0:1781281094.018790:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6a7 expref: 546 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018808:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.018811:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.018839:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018852:0:15255:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 545 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018862:0:15255:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018892:0:15255:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 545 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.018902:0:15255:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 545 pid: 6155 timeout: 716 lvb_type: 0 00000100:00100000:2.0:1781281094.018913:0:15255:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083777408:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281094.018979:0:15255:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d8827c62 going to sleep for 43 seconds 00000100:00100000:2.0:1781281094.021939:0:15255:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083777408:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281094.021977:0:15255:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.022395:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.029427:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.029490:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752576 00010000:00010000:0.0:1781281094.029538:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00000100:00100000:0.0:1781281094.029599:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4781 00000100:00100000:0.0:1781281094.029606:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+546:2270:x1867808064752576:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281094.029621:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281094.029639:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281094.029651:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281094.029676:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd216c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6fb expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281094.029693:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:0.0:1781281094.029698:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.029708:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.029715:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.029745:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281094.029793:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+545:2270:x1867808064752576:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 185us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.029800:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4781 00010000:00010000:2.0:1781281094.031830:0:6157:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.031849:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.031881:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.031895:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.031905:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.032033:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.032042:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.032048:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.032481:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].430, 64 off35840 00000040:00080000:2.0:1781281094.032503:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4988, 184 off876056 00010000:00010000:2.0:1781281094.032622:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x266:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.033619:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.034187:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752640 00010000:00010000:0.0:1781281094.034295:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00000100:00100000:0.0:1781281094.034391:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4782 00010000:00010000:2.0:1781281094.034397:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.034399:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+546:2268:x1867808064752640:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281094.034407:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034413:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034419:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.034419:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281094.034425:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281094.034436:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:0.0:1781281094.034463:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd216cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a702 expref: 546 pid: 6155 timeout: 716 lvb_type: 0 00010000:00010000:2.0:1781281094.034508:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.034561:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eee05b06 reply state 000000009a8582d6 transno 4294975524 ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034583:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.034588:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034596:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6383283 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.034600:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034607:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034616:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x266:0x0].0x0 (00000000f461ce22) 00010000:00010000:2.0:1781281094.034618:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.034623:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.034779:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.034784:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034785:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd216ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034800:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.034801:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.034803:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.034859:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.034863:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034871:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.034871:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034877:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034882:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000040d91bad already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.034885:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034890:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034898:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:0.0:1781281094.034899:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.034900:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.034902:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.034907:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd216d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.034914:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eee05b06 reply state 000000009a8582d6 transno 4294975524 ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.034966:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+546:2268:x1867808064752640:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 561us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.034977:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4782 00000100:00100000:2.0:1781281094.039907:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eee05b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+545:12456:x1867808064752128:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 28297us (29561us total) trans 4294975524 rc 0/0 00000100:00100000:2.0:1781281094.039922:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16296 00010000:00010000:2.0:1781281094.039989:0:15255:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040002:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040034:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x283705e2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040048:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040059:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040205:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040213:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.040220:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.041399:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].431, 64 off35904 00000040:00080000:2.0:1781281094.041601:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4989, 184 off876240 00010000:00010000:2.0:1781281094.041760:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041779:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041789:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041799:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041806:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041812:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041832:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.041854:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001fba7a40 reply state 00000000d8415a3b transno 4294975525 ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041903:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041909:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041915:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041922:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c67a4441 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.041925:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041932:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041948:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.041952:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.041955:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.041961:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd216d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.041970:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001fba7a40 reply state 00000000d8415a3b transno 4294975525 ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.042058:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+546:12455:x1867808064752448:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 23401us (23722us total) trans 4294975525 rc 0/0 00000100:00100000:2.0:1781281094.042067:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16298 00010000:00010000:0.0:1781281094.045598:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.045612:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.045629:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b5799f48 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.045632:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.045642:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.045666:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a0:0x0].0x0 (0000000028c7e7bb) 00010000:00010000:0.0:1781281094.045669:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.045673:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.045678:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd21703 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.045696:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.045697:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.045699:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.046225:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.046237:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x8d5ea5b7 (000000001bab2cea) 00010000:00010000:0.0:1781281094.046239:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.046242:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.046248:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x266:0x0].0x0 (00000000f461ce22) 00010000:00010000:0.0:1781281094.046250:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.046815:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752768 00000100:00100000:2.0:1781281094.046876:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4705 00000100:00100000:2.0:1781281094.046884:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+546:12456:x1867808064752768:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.047265:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+547:12456:x1867808064752768:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 380us (1137us total) trans 4294975526 rc 0/0 00000100:00100000:2.0:1781281094.047273:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4705 00010000:00010000:2.0:1781281094.052962:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.052990:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x283705e2 (00000000566a0164) 00010000:00010000:2.0:1781281094.052992:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.052997:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.053005:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a0:0x0].0x0 (0000000028c7e7bb) 00010000:00010000:2.0:1781281094.053006:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.058026:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064752896 00000100:00100000:3.0:1781281094.058090:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4706 00000100:00100000:3.0:1781281094.058098:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+547:12455:x1867808064752896:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.058384:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+548:12455:x1867808064752896:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 285us (1647us total) trans 4294975527 rc 0/0 00000100:00100000:3.0:1781281094.058392:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4706 00000100:00100000:0.0:1781281094.059911:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.059987:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753024 00000100:00100000:2.0:1781281094.060039:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16299 00000100:00100000:2.0:1781281094.060044:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000338c87f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+548:12456:x1867808064753024:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.060095:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.060122:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057b4679c/0xce40b48e7cd203d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x262:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a343 expref: 548 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060145:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071f3f8cb/0xce40b48e7cd0bb2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x262:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03780 expref: 547 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060158:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000254a8e2b/0xce40b48e7cd0bb87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x262:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c037a3 expref: 546 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060171:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082cc0e1b/0xce40b48e7cd02784 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x262:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0053e expref: 545 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060181:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x262:0x0].0x0 (000000002033747b) 00010000:00010000:2.0:1781281094.060191:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.060219:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060232:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060243:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060257:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x260:0x0].0xe364b611 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060264:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060270:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060373:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x262:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060381:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.060388:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.060976:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].405, 64 off34112 00000040:00080000:2.0:1781281094.060999:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4990, 184 off876424 00010000:00010000:2.0:1781281094.061066:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x262:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061079:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061087:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061099:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061105:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061111:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061127:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.061144:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000338c87f7 reply state 0000000022f84d62 transno 4294975528 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061188:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061194:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061200:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061206:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c67a4441 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.061209:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061215:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061230:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:2.0:1781281094.061232:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.061236:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.061241:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c67a4441/0xce40b48e7cd2170a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.061249:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000338c87f7 reply state 0000000022f84d62 transno 4294975528 ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.061321:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000338c87f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+546:12456:x1867808064753024:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1274us (1415us total) trans 4294975528 rc 0/0 00000100:00100000:2.0:1781281094.061329:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16299 00010000:00010000:3.0:1781281094.061984:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.061990:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.061997:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b5799f48 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.062000:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.062007:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.062017:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x262:0x0].0x0 (00000000bb974c6b) 00010000:00010000:3.0:1781281094.062019:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.062022:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.062027:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5799f48/0xce40b48e7cd2171f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.062039:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.062040:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.062042:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281094.065832:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.065996:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.066044:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753280 00000100:00100000:3.0:1781281094.066106:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4707 00000100:00100000:3.0:1781281094.066114:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+546:12456:x1867808064753280:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.066390:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+547:12456:x1867808064753280:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 275us (395us total) trans 4294975529 rc 0/0 00000100:00100000:3.0:1781281094.066401:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4707 00000100:00100000:2.0:1781281094.066720:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753152 00000100:00100000:2.0:1781281094.066751:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16300 00000100:00100000:2.0:1781281094.066756:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+547:12455:x1867808064753152:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.066787:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.066815:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076b882dc/0xce40b48e7cd1f808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x392:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09edc expref: 547 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066836:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fba406c2/0xce40b48e7cd1d697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x392:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0924f expref: 546 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066847:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007735f723/0xce40b48e7cd1d6dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x392:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09264 expref: 545 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066863:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd1c732 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x392:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08ca6 expref: 544 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066873:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x392:0x0].0x0 (0000000013cefdc8) 00010000:00010000:2.0:1781281094.066883:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.066914:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066929:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066939:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066955:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066962:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.066968:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.067064:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x392:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.067073:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.067084:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.069350:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].432, 64 off35968 00010000:00010000:0.0:1781281094.070557:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.070580:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0xe364b611 (0000000087de360d) 00010000:00010000:0.0:1781281094.070582:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:2.0:1781281094.070588:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4992, 184 off876728 00010000:00010000:0.0:1781281094.070588:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.070599:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x262:0x0].0x0 (00000000bb974c6b) 00010000:00010000:0.0:1781281094.070600:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281094.070919:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x392:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070936:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070945:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070952:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070960:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070965:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.070990:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.071011:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f179f403 reply state 000000003a94f364 transno 4294975530 ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071062:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071069:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071074:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071080:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029b661d0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.071084:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071092:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071104:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.071106:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.071109:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.071114:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21726 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.071123:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f179f403 reply state 000000003a94f364 transno 4294975530 ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.071204:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+545:12455:x1867808064753152:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 4444us (5383us total) trans 4294975530 rc 0/0 00000100:00100000:2.0:1781281094.071214:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16300 00010000:00010000:0.0:1781281094.071354:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.071359:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.071365:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a3c7ac32 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.071367:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.071373:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.071381:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x392:0x0].0x0 (000000008312843f) 00010000:00010000:0.0:1781281094.071383:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.071385:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.071389:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd2173b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x392:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.071400:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.071402:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.071403:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281094.073597:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.073795:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753408 00000100:00100000:0.0:1781281094.073855:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16301 00000100:00100000:0.0:1781281094.073864:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+545:12456:x1867808064753408:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.073926:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.073955:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd2041e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x264:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a35f expref: 545 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.073976:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081f95b5d/0xce40b48e7cd0bc59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x264:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c037f0 expref: 544 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.073993:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003d75374f/0xce40b48e7cd0bcc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x264:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0380c expref: 543 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074006:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001496d6e5/0xce40b48e7cd0288e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x264:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00599 expref: 542 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074016:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x264:0x0].0x0 (000000006f7f2ef2) 00010000:00010000:0.0:1781281094.074026:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.074058:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074074:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074083:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074098:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074104:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074112:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074224:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074232:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.074238:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.077016:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].433, 64 off36032 00000040:00080000:0.0:1781281094.077051:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4993, 184 off876912 00010000:00010000:0.0:1781281094.077171:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x264:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077190:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077203:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077213:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077219:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077225:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077259:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.077281:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000015ad8ffb reply state 0000000009df879f transno 4294975531 ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077338:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077345:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077352:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077358:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aaa5c9f9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.077361:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077368:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077381:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (000000008fafd685) 00010000:00010000:0.0:1781281094.077385:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.077389:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.077395:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd21742 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x260:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.077408:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000015ad8ffb reply state 0000000009df879f transno 4294975531 ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.077535:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+543:12456:x1867808064753408:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 3669us (3996us total) trans 4294975531 rc 0/0 00000100:00100000:0.0:1781281094.077575:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16301 00010000:00010000:2.0:1781281094.077905:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.077910:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.077918:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d8556b73 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.077920:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.077927:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.077936:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x264:0x0].0x0 (000000003ffba7e5) 00010000:00010000:2.0:1781281094.077938:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.077940:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.077944:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21757 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.077956:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.077957:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.077958:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.086925:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753536 00000100:00100000:2.0:1781281094.086977:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4708 00000100:00100000:2.0:1781281094.086984:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000595813a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+543:12455:x1867808064753536:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.087221:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000595813a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+544:12455:x1867808064753536:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 236us (361us total) trans 4294975532 rc 0/0 00000100:00100000:2.0:1781281094.087229:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4708 00010000:00010000:0.0:1781281094.087317:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.087332:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x8b6dba3a (00000000c026c2d1) 00010000:00010000:0.0:1781281094.087335:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.087340:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.087346:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x264:0x0].0x0 (000000003ffba7e5) 00010000:00010000:0.0:1781281094.087348:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.088653:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753600 00000100:00100000:3.0:1781281094.088695:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4709 00000100:00100000:3.0:1781281094.088701:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+544:12456:x1867808064753600:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:0.0:1781281094.089691:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753728 00000100:00100000:0.0:1781281094.089725:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16302 00000100:00100000:0.0:1781281094.089729:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+546:12455:x1867808064753728:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.089772:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.089802:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd2053d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x255:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a3cf expref: 546 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089825:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c7af1a1/0xce40b48e7cd089f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x255:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02590 expref: 545 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089837:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c439bc10/0xce40b48e7cd08a48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x255:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c025ac expref: 544 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089848:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004c119d3e/0xce40b48e7cd0224b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x255:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00338 expref: 543 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089857:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x255:0x0].0x0 (000000002a0f5a3f) 00010000:00010000:0.0:1781281094.089866:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.089891:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089905:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089916:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089930:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089936:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.089941:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090017:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x255:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090024:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090030:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.090384:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].406, 64 off34176 00000040:00080000:0.0:1781281094.090403:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4994, 184 off877096 00010000:00010000:0.0:1781281094.090484:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x255:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090494:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090502:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090519:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090525:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090532:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd21773 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090583:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.090602:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006feda5c1 reply state 00000000d859eff7 transno 4294975533 ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090644:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090650:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090656:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090661:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eb7c1166 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.090664:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090669:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090676:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.090678:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.090680:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.090685:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd2175e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.090692:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006feda5c1 reply state 00000000d859eff7 transno 4294975533 ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.090764:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+544:12455:x1867808064753728:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1032us (1117us total) trans 4294975533 rc 0/0 00000100:00100000:0.0:1781281094.090774:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16302 00000100:00100000:0.0:1781281094.094146:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.094944:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+542:12456:x1867808064753600:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 6240us (6351us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.094958:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4709 00010000:00010000:0.0:1781281094.095177:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.095196:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x98ca20bd (00000000cd877e7d) 00010000:00010000:0.0:1781281094.095199:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.095204:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.095209:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x255:0x0].0x0 (00000000f45622b2) 00010000:00010000:0.0:1781281094.095211:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.095714:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753856 00000100:00100000:2.0:1781281094.104316:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.104709:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a757009e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+543:12455:x1867808064753856:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 610us (10570us total) trans 4294975534 rc 0/0 00000100:00100000:0.0:1781281094.104720:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4710 00000100:00100000:0.0:1781281094.104757:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064753984 00000100:00100000:0.0:1781281094.104788:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4711 00000100:00100000:0.0:1781281094.104792:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+543:12456:x1867808064753984:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.104871:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+544:12456:x1867808064753984:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 77us (555us total) trans 4294975535 rc 0/0 00000100:00100000:0.0:1781281094.104878:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4711 00000100:00100000:0.0:1781281094.106996:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.107302:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754112 00000100:00100000:2.0:1781281094.107355:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16303 00000100:00100000:2.0:1781281094.107361:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f90863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+544:12455:x1867808064754112:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.107418:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.107449:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd204bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x251:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a39e expref: 544 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107472:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c9bd9ea3/0xce40b48e7cd0862e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x251:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02463 expref: 543 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107486:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e2062c87/0xce40b48e7cd08689 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x251:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02486 expref: 542 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107505:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f813d891/0xce40b48e7cd020c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x251:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00290 expref: 541 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107524:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x251:0x0].0x0 (00000000add04949) 00010000:00010000:2.0:1781281094.107533:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.107622:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107637:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107647:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107662:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xf2061246 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107669:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107675:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107781:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x251:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.107790:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.108264:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.108707:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].407, 64 off34240 00000040:00080000:2.0:1781281094.108729:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4995, 184 off877280 00000100:00100000:3.0:1781281094.110598:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754240 00000100:00100000:3.0:1781281094.110669:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16304 00000100:00100000:3.0:1781281094.110677:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+542:12456:x1867808064754240:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.110746:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281094.110784:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007852caa0/0xce40b48e7cd14c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0677d expref: 542 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110811:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000083d49faf/0xce40b48e7cd06304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c018e0 expref: 541 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110828:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aebed1cf/0xce40b48e7cd06343 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c018f5 expref: 540 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110840:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd01214 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc8c expref: 539 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110850:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22c:0x0].0x0 (000000001d112f30) 00010000:00010000:3.0:1781281094.110872:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006092e5fa/0xce40b48e7cd2139f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6c3 expref: 538 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110892:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:3.0:1781281094.110896:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.110938:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110957:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110967:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110983:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110989:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.110995:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111112:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111120:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111127:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.111586:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].408, 64 off34304 00000040:00080000:3.0:1781281094.111609:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4996, 176 off877456 00010000:00010000:3.0:1781281094.111667:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111676:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111683:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111690:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111696:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111701:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111715:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.111746:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c3c25c8b reply state 000000001b74f5a2 transno 4294975537 ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111793:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111799:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111810:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111815:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000008eb17f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.111818:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111826:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111836:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:3.0:1781281094.111838:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.111841:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.111846:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd21796 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.111853:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c3c25c8b reply state 000000001b74f5a2 transno 4294975537 ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.111948:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+539:12456:x1867808064754240:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1269us (1456us total) trans 4294975537 rc 0/0 00000100:00100000:3.0:1781281094.111957:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16304 00010000:00010000:2.0:1781281094.113611:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x251:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113635:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113648:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113657:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113663:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113674:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113698:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:2.0:1781281094.113721:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7f90863 reply state 00000000d3be985f transno 4294975536 ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113780:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113783:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281094.113787:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113788:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113792:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113798:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029b661d0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.113801:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d2e223b3 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.113802:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113803:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113810:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113810:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113823:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22c:0x0].0x0 (0000000016e87ae1) 00010000:00010000:2.0:1781281094.113823:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.113826:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.113826:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.113829:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113829:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113836:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd217ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.113836:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd2177a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.113845:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7f90863 reply state 00000000d3be985f transno 4294975536 ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113847:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.113849:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113855:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ad51d6c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.113856:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113861:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113866:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x251:0x0].0x0 (0000000075b742c1) 00010000:00010000:3.0:1781281094.113868:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.113870:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113874:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd2178f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.113882:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.113884:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.113885:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.113944:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f90863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+539:12455:x1867808064754112:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 6579us (6953us total) trans 4294975536 rc 0/0 00000100:00100000:2.0:1781281094.113953:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16303 00010000:00010000:0.0:1781281094.114067:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.115806:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.115828:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x14be06ab (00000000a86c7917) 00010000:00010000:0.0:1781281094.115831:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.115836:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.115841:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22c:0x0].0x0 (0000000016e87ae1) 00010000:00010000:0.0:1781281094.115843:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281094.117682:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.117700:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xf2061246 (00000000901d93ec) 00010000:00010000:0.0:1781281094.117703:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.117707:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.117713:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x251:0x0].0x0 (0000000075b742c1) 00010000:00010000:0.0:1781281094.117715:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.118790:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.118836:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.118988:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754368 00000100:00100000:3.0:1781281094.119038:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754496 00000100:00100000:3.0:1781281094.119110:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4712 00000100:00100000:3.0:1781281094.119117:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8bb8602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+540:12456:x1867808064754368:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.119373:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8bb8602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+541:12456:x1867808064754368:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 255us (590us total) trans 4294975538 rc 0/0 00000100:00100000:3.0:1781281094.119381:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4712 00000100:00100000:3.0:1781281094.119398:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4713 00000100:00100000:3.0:1781281094.119401:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+540:12455:x1867808064754496:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.119502:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+541:12455:x1867808064754496:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 99us (666us total) trans 4294975539 rc 0/0 00000100:00100000:3.0:1781281094.119517:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4713 00000100:00100000:0.0:1781281094.129402:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754624 00000100:00100000:0.0:1781281094.129465:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754752 00000100:00100000:0.0:1781281094.129490:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16305 00000100:00100000:0.0:1781281094.129497:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+542:12455:x1867808064754624:12345-192.168.202.40@tcp:36:dbench.0 00000100:00100000:2.0:1781281094.129572:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16306 00000100:00100000:2.0:1781281094.129578:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+542:12456:x1867808064754752:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.129581:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.129612:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2050c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x253:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a3ba expref: 542 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129640:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.129649:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000049f8043/0xce40b48e7cd08849 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x253:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02512 expref: 541 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129651:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b9948e9/0xce40b48e7cd16a5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c070de expref: 541 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129662:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f7977ef7/0xce40b48e7cd0888f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x253:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02527 expref: 539 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129668:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee8c0662/0xce40b48e7cd064bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01965 expref: 539 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129674:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000308b5ca0/0xce40b48e7cd021aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x253:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002f2 expref: 537 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129679:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000baeb5292/0xce40b48e7cd06526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01981 expref: 537 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129690:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x253:0x0].0x0 (00000000b5a4d672) 00010000:00010000:2.0:1781281094.129693:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010b493c4/0xce40b48e7cd0131e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffce7 expref: 535 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129699:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22e:0x0].0x0 (0000000042e48e1a) 00010000:00010000:0.0:1781281094.129702:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.129705:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.129734:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129734:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129750:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129750:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129760:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129761:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129774:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129774:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129781:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129781:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129788:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129788:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129885:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129885:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x253:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129893:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129893:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.129900:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.129900:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.130406:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].409, 64 off34368 00000040:00080000:0.0:1781281094.130428:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4997, 184 off877640 00010000:00010000:0.0:1781281094.130492:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x253:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130504:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x253:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130523:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x253:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130531:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x253:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130537:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x253:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130566:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd217dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x253:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130588:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.130606:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d6571539 reply state 000000008b4fd12b transno 4294975540 ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130865:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130872:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130883:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130889:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d874006 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.130892:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130898:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130910:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.130913:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.130916:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.130921:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd217b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.130931:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d6571539 reply state 000000008b4fd12b transno 4294975540 ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.131013:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+536:12455:x1867808064754624:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1514us (1768us total) trans 4294975540 rc 0/0 00000100:00100000:0.0:1781281094.131022:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16305 00000040:00080000:2.0:1781281094.134254:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].434, 64 off36096 00000040:00080000:2.0:1781281094.134278:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4998, 184 off877824 00010000:00010000:2.0:1781281094.134349:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134366:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134376:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134384:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134389:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134394:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134411:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.134449:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a94c2913 reply state 00000000f96dc589 transno 4294975541 ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134733:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134742:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134748:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134753:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.134756:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134766:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134777:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:2.0:1781281094.134780:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.134784:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.134789:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.134798:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a94c2913 reply state 00000000f96dc589 transno 4294975541 ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.134889:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+537:12456:x1867808064754752:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 5307us (5575us total) trans 4294975541 rc 0/0 00000100:00100000:2.0:1781281094.134898:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16306 00010000:00010000:3.0:1781281094.136671:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.136681:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.136694:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029b661d0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.136698:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.136707:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.136726:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22e:0x0].0x0 (000000002033747b) 00010000:00010000:3.0:1781281094.136730:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.136734:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.136740:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd217e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.136756:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.136758:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.136759:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.140427:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.140458:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xbcf75103 (00000000ee546b8d) 00010000:00010000:0.0:1781281094.140463:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.140468:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.140474:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x253:0x0].0x0 (00000000dbaaf69f) 00010000:00010000:0.0:1781281094.140476:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.140610:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064754880 00000100:00100000:3.0:1781281094.140658:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4714 00000100:00100000:3.0:1781281094.140665:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000107f2932 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+537:12455:x1867808064754880:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.140984:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000107f2932 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+538:12455:x1867808064754880:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 318us (669us total) trans 4294975542 rc 0/0 00000100:00100000:3.0:1781281094.140992:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4714 00010000:00010000:0.0:1781281094.144186:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.144209:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x77103a66 (0000000013cefdc8) 00010000:00010000:0.0:1781281094.144212:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.144218:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.144224:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22e:0x0].0x0 (000000002033747b) 00010000:00010000:0.0:1781281094.144226:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.153917:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.154076:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755008 00000100:00100000:2.0:1781281094.154145:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16307 00000100:00100000:2.0:1781281094.154152:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a757009e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+538:12455:x1867808064755008:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.154210:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.154240:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003ff4935a/0xce40b48e7cd1f77c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09ea4 expref: 538 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154263:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd07151 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01d94 expref: 537 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154281:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ef66d/0xce40b48e7cd071ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01dbe expref: 536 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154293:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd0187a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff02 expref: 535 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154304:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23b:0x0].0x0 (00000000174a3c69) 00010000:00010000:2.0:1781281094.154314:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.154346:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154362:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154372:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154386:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154392:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154398:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154532:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154574:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.154580:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.154960:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].410, 64 off34432 00000040:00080000:2.0:1781281094.154979:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4999, 184 off878008 00010000:00010000:2.0:1781281094.155410:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155422:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155430:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155436:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155442:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155448:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155605:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.155623:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a757009e reply state 00000000052037a2 transno 4294975543 ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155673:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155679:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155686:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155692:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.155695:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155702:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155712:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.155714:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.155718:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.155723:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd217ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.155734:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a757009e reply state 00000000052037a2 transno 4294975543 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.155824:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a757009e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+536:12455:x1867808064755008:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1670us (1914us total) trans 4294975543 rc 0/0 00000100:00100000:2.0:1781281094.155833:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16307 00010000:00010000:3.0:1781281094.157225:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.157233:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.157245:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002621cf99 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.157248:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.157256:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.157270:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23b:0x0].0x0 (000000000a2880eb) 00010000:00010000:3.0:1781281094.157273:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.157275:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 1/0,0 mode: --/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.157280:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd217ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.161178:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281094.162071:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.162087:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xca0b3ea (000000000ef68632) 00010000:00010000:0.0:1781281094.162090:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.162095:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.162101:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23b:0x0].0x0 (000000000a2880eb) 00010000:00010000:0.0:1781281094.162103:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.166100:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755264 00000100:00100000:3.0:1781281094.166161:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4716 00000100:00100000:3.0:1781281094.166168:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+537:12455:x1867808064755264:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.166431:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+538:12455:x1867808064755264:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 263us (487us total) trans 4294975545 rc 0/0 00000100:00100000:3.0:1781281094.166440:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4716 00000100:00100000:2.0:1781281094.166994:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.168607:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755392 00000100:00100000:3.0:1781281094.168676:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16308 00000100:00100000:3.0:1781281094.168683:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+538:12456:x1867808064755392:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.168748:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.168782:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032488f05/0xce40b48e7cd16e15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07220 expref: 538 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168811:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd066d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x230:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01a0d expref: 537 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168826:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f814558f/0xce40b48e7cd06780 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x230:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01a53 expref: 536 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168839:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d37218dc/0xce40b48e7cd013db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x230:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd34 expref: 535 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168850:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x230:0x0].0x0 (000000003f32792c) 00010000:00010000:3.0:1781281094.168860:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.168897:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168912:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168923:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168938:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168945:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.168951:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169053:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169065:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169071:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.169436:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].435, 64 off36160 00000040:00080000:3.0:1781281094.169457:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5000, 184 off878192 00010000:00010000:3.0:1781281094.169579:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169589:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169597:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169603:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169610:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169615:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd2181b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169631:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.169649:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df5cee7c reply state 0000000042707a55 transno 4294975546 ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169717:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169724:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169730:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169735:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d2e223b3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.169739:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169747:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169757:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:3.0:1781281094.169760:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.169762:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.169768:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21806 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.169778:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df5cee7c reply state 0000000042707a55 transno 4294975546 ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.169862:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+536:12456:x1867808064755392:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1177us (2868us total) trans 4294975546 rc 0/0 00000100:00100000:3.0:1781281094.169871:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16308 00010000:00010000:3.0:1781281094.172710:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.172721:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd21837 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.172731:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ea6efce0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.172735:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd21837 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.172744:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd21837 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.172758:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39f:0x0].0x0 (0000000081e11052) 00010000:00010000:3.0:1781281094.172761:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.172763:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd21837 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.172768:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd21837 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.172782:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.172783:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.172784:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.172843:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.172846:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.172847:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.173677:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.173693:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0xc4fc354d (000000001d112f30) 00010000:00010000:0.0:1781281094.173695:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.173699:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.173704:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x230:0x0].0x0 (0000000029006562) 00010000:00010000:0.0:1781281094.173707:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281094.177910:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.177937:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x8ee21578 (000000009c26cfbf) 00010000:00010000:0.0:1781281094.177941:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.177946:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.177953:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39f:0x0].0x0 (0000000081e11052) 00010000:00010000:0.0:1781281094.177955:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.178300:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755584 00000100:00100000:2.0:1781281094.178337:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755712 00000100:00100000:2.0:1781281094.178355:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4717 00000100:00100000:2.0:1781281094.178360:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+536:12456:x1867808064755584:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:2.0:1781281094.181465:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+536:12456:x1867808064755584:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 3095us (3276us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.181480:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4717 00000100:00100000:2.0:1781281094.192250:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000040:00080000:0.0:1781281094.198374:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].436, 64 off36224 00000040:00080000:0.0:1781281094.198398:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5002, 184 off878560 00010000:00010000:0.0:1781281094.198485:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198515:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198528:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198537:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198692:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198698:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd21853 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198720:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.198747:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bc1b8f82 reply state 00000000f7680855 transno 4294975549 ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198795:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198801:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198807:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198813:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000390a2f94 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.198816:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198822:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198834:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.198837:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.198842:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.198848:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd2183e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.198858:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bc1b8f82 reply state 00000000f7680855 transno 4294975549 ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.198953:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1b8f82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+534:12455:x1867808064755840:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 4836us (6707us total) trans 4294975549 rc 0/0 00000100:00100000:0.0:1781281094.198964:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16310 00000100:00100000:2.0:1781281094.206184:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.206288:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064755968 00000100:00100000:3.0:1781281094.206344:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4719 00000100:00100000:3.0:1781281094.206350:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+534:12455:x1867808064755968:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.206665:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+535:12455:x1867808064755968:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 313us (488us total) trans 4294975550 rc 0/0 00000100:00100000:3.0:1781281094.206673:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4719 00000100:00100000:0.0:1781281094.224334:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3e3d67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083777472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1781281094.224446:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281094.224734:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777472 00000100:00100000:2.0:1781281094.224787:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1781281094.224801:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8bb8602 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083777472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1781281094.224845:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3834642432 avail 3832545280 00000100:00100000:2.0:1781281094.224898:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8bb8602 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083777472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.224905:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1781281094.226146:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3e3d67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083777472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1781281094.232428:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.234410:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281094.240265:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.240270:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2186f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x243:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.240277:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069b7952d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.240280:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2186f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x243:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.240286:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2186f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x243:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.240295:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x243:0x0].0x0 (000000002ba2d389) 00010000:00010000:3.0:1781281094.240297:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.240300:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2186f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x243:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.240305:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2186f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x243:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.240315:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.240316:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.240317:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.253587:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064756544 00010000:00010000:2.0:1781281094.253622:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 531 pid: 14242 timeout: 716 lvb_type: 0 00000100:00100000:2.0:1781281094.253653:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4783 00000100:00100000:2.0:1781281094.253659:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+531:2270:x1867808064756544:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281094.253676:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281094.253681:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 531 pid: 14242 timeout: 716 lvb_type: 0 00010000:00010000:2.0:1781281094.253693:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 531 pid: 14242 timeout: 716 lvb_type: 0 00010000:00010000:2.0:1781281094.253710:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:2.0:1781281094.253713:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.253722:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.253727:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.253743:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281094.253788:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+531:2270:x1867808064756544:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 129us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.253803:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4783 00010000:00010000:0.0:1781281094.254613:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd213bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ca expref: 530 pid: 14242 timeout: 716 lvb_type: 0 00000100:00100000:0.0:1781281094.254633:0:6155:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e8555b3 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6155:1867808083777536:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281094.254655:0:6155:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254663:0:6155:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254669:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254691:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254706:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254715:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254840:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254849:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.254855:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.257004:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].413, 64 off34624 00000040:00080000:0.0:1781281094.257036:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5004, 176 off878920 00010000:00010000:0.0:1781281094.257126:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257146:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257158:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257165:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257170:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257176:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257210:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.257233:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ce310b52 reply state 00000000f50ce7b5 transno 4294975553 ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257286:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257293:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257299:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257306:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000390a2f94 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.257310:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257318:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257335:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:0.0:1781281094.257338:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.257342:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.257350:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000390a2f94/0xce40b48e7cd21876 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.257363:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ce310b52 reply state 00000000f50ce7b5 transno 4294975553 ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.257599:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce310b52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+531:12456:x1867808064756352:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 9622us (12176us total) trans 4294975553 rc 0/0 00000100:00100000:0.0:1781281094.257609:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16312 00010000:00010000:2.0:1781281094.262499:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.262520:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.262536:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aaa5c9f9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.262557:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.262575:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.262593:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x203:0x0].0x0 (00000000eac9b33f) 00010000:00010000:2.0:1781281094.262596:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.262601:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.262607:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd2188b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.262627:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.262628:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.262630:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.263924:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281094.264055:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.264072:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xe5dc7a0b (00000000f8b7c99c) 00010000:00010000:2.0:1781281094.264075:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.264079:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.264086:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x203:0x0].0x0 (00000000eac9b33f) 00010000:00010000:2.0:1781281094.264088:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.264313:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064756480 00000100:00100000:0.0:1781281094.264363:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4721 00000100:00100000:0.0:1781281094.264370:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+531:12455:x1867808064756480:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.264657:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+532:12455:x1867808064756480:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 286us (741us total) trans 4294975554 rc 0/0 00000100:00100000:0.0:1781281094.264665:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4721 00000100:00100000:0.0:1781281094.265483:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.280819:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.285044:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281094.287571:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.287577:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd218c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.287584:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c84ea5a8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.287586:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd218c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.287592:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd218c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.287601:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x257:0x0].0x0 (0000000025c4d843) 00010000:00010000:3.0:1781281094.287603:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.287605:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd218c3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.287610:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd218c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.287620:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.287621:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.287622:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281094.292655:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.292688:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.292719:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757056 00000100:00100000:3.0:1781281094.292757:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757184 00000100:00100000:3.0:1781281094.292772:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4723 00000100:00100000:3.0:1781281094.292777:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+530:12456:x1867808064757056:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.293009:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+531:12456:x1867808064757056:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 230us (363us total) trans 4294975558 rc 0/0 00000100:00100000:3.0:1781281094.293021:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4723 00000100:00100000:3.0:1781281094.293038:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4724 00000100:00100000:3.0:1781281094.293042:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008875583 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+530:12455:x1867808064757184:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.293116:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008875583 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+531:12455:x1867808064757184:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 73us (428us total) trans 4294975559 rc 0/0 00000100:00100000:3.0:1781281094.293123:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4724 00000100:00100000:0.0:1781281094.295535:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.295596:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.295629:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757312 00000100:00100000:0.0:1781281094.295669:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757440 00000100:00100000:0.0:1781281094.295688:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16315 00000100:00100000:0.0:1781281094.295694:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c3cacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+532:12456:x1867808064757312:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.295752:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.295779:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f735c66c/0xce40b48e7cd1889b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c077fa expref: 532 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.295923:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000045e70b0a/0xce40b48e7cd044cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x205:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00f08 expref: 531 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.295944:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000352e4660/0xce40b48e7cd044f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x205:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00f16 expref: 530 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.295955:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010114766/0xce40b48e7cd00269 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x205:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff642 expref: 529 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.295966:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x205:0x0].0x0 (000000000d7f90d4) 00010000:00010000:0.0:1781281094.295975:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.296008:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296021:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296030:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296044:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296049:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296054:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296147:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296159:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.296165:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.297377:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].416, 64 off34816 00000040:00080000:0.0:1781281094.297400:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5007, 184 off879472 00010000:00010000:0.0:1781281094.297471:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297487:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297499:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297517:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297523:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297528:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd218df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297573:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.297592:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b3c3cacd reply state 000000001542badd transno 4294975560 ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297650:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297656:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297662:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297667:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000011eb364e already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.297669:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297675:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297686:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:0.0:1781281094.297688:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.297692:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.297697:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd218ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.297708:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b3c3cacd reply state 000000001542badd transno 4294975560 ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.298451:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c3cacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+530:12456:x1867808064757312:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2753us (2920us total) trans 4294975560 rc 0/0 00000100:00100000:0.0:1781281094.298465:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16315 00000100:00100000:0.0:1781281094.298501:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16316 00000100:00100000:0.0:1781281094.298516:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+529:12455:x1867808064757440:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.298594:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.298612:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceb26d82/0xce40b48e7cd1f6fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x237:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09e73 expref: 529 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298625:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac27d2a0/0xce40b48e7cd06d14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x237:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01c36 expref: 528 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298638:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd06db5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x237:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01c60 expref: 527 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298648:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095415c04/0xce40b48e7cd016d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x237:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe53 expref: 526 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298656:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x237:0x0].0x0 (00000000e61cd319) 00010000:00010000:0.0:1781281094.298663:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.298682:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298693:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298701:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298714:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298720:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298725:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298811:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x237:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298819:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.298824:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.299124:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].417, 64 off34880 00000040:00080000:0.0:1781281094.299140:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5008, 184 off879656 00010000:00010000:0.0:1781281094.299186:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299266:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299274:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299280:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299286:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299292:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd218fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299312:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.299328:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001bf46d96 reply state 00000000ebb4fa84 transno 4294975561 ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299371:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299377:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299382:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299387:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6705277 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.299390:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299396:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299404:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.299406:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.299409:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.299414:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd218e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.299424:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001bf46d96 reply state 00000000ebb4fa84 transno 4294975561 ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.299485:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+527:12455:x1867808064757440:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 976us (3887us total) trans 4294975561 rc 0/0 00000100:00100000:0.0:1781281094.299492:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16316 00000100:00100000:0.0:1781281094.309122:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757568 00000100:00100000:0.0:1781281094.309163:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064757696 00000100:00100000:0.0:1781281094.309183:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4725 00000100:00100000:0.0:1781281094.309188:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+528:12456:x1867808064757568:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.309416:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+529:12456:x1867808064757568:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 226us (628us total) trans 4294975562 rc 0/0 00000100:00100000:0.0:1781281094.309425:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4725 00000100:00100000:0.0:1781281094.309444:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4726 00000100:00100000:0.0:1781281094.309448:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003798e19c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+528:12455:x1867808064757696:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.309537:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003798e19c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+529:12455:x1867808064757696:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 87us (648us total) trans 4294975563 rc 0/0 00000100:00100000:0.0:1781281094.309567:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4726 00010000:00010000:3.0:1781281094.312849:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.312865:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xf4ed591 (00000000558ed917) 00010000:00010000:3.0:1781281094.312868:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.312872:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.312877:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x205:0x0].0x0 (00000000d6b1f872) 00010000:00010000:3.0:1781281094.312878:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.317965:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16318 00000100:00100000:3.0:1781281094.317971:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006917bf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+529:12455:x1867808064757952:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.317992:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.318004:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd20353 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x245:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a319 expref: 529 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318018:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000da639fd5/0xce40b48e7cd07a88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x245:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02096 expref: 528 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318030:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000deee87a/0xce40b48e7cd07b14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x245:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c020ce expref: 527 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318041:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bd05f324/0xce40b48e7cd01bec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x245:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00083 expref: 526 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318050:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x245:0x0].0x0 (000000007ef33e22) 00010000:00010000:3.0:1781281094.318060:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.318089:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318103:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318112:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318126:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318133:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318139:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318249:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318257:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318268:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.318657:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].437, 64 off36288 00000040:00080000:3.0:1781281094.318677:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5009, 184 off879840 00010000:00010000:3.0:1781281094.318736:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x245:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318746:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318754:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318761:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318766:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318773:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318803:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.318818:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006917bf59 reply state 000000007366457f transno 4294975564 ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318863:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318874:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318880:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318885:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d2e223b3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.318888:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318896:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318904:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.318907:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.318911:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.318916:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21902 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.318925:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006917bf59 reply state 000000007366457f transno 4294975564 ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.319006:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006917bf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+527:12455:x1867808064757952:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1033us (6924us total) trans 4294975564 rc 0/0 00000100:00100000:3.0:1781281094.319014:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16318 00010000:00010000:2.0:1781281094.319238:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.319242:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.319250:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.319253:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.319259:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.319268:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x245:0x0].0x0 (0000000063efd5b7) 00010000:00010000:2.0:1781281094.319270:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.319272:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.319277:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21917 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.319288:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.319289:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.319291:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.320901:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.320906:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd21933 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.320914:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034e1a575 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.320917:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd21933 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.320924:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd21933 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.320938:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x207:0x0].0x0 (000000002a0f5a3f) 00010000:00010000:2.0:1781281094.320940:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.320942:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd21933 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.320948:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd21933 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.320958:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.320960:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.320961:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1781281094.324249:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968302 is committed 00000001:00080000:0.0:1781281094.324269:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968298 is committed 00000001:00080000:0.0:1781281094.324279:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968299 is committed 00000001:00080000:0.0:1781281094.324293:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968303 is committed 00000001:00080000:0.0:1781281094.324297:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968300 is committed 00010000:00010000:3.0:1781281094.324961:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.324980:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x103f9c81 (0000000031a80ae1) 00010000:00010000:3.0:1781281094.324983:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.324988:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.324994:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x245:0x0].0x0 (0000000063efd5b7) 00010000:00010000:3.0:1781281094.324996:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281094.326538:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.326584:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x469e1765 (00000000add04949) 00010000:00010000:2.0:1781281094.326587:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.326591:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.326597:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x207:0x0].0x0 (000000002a0f5a3f) 00010000:00010000:2.0:1781281094.326598:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.328522:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.328652:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758080 00000100:00100000:3.0:1781281094.328700:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4727 00000100:00100000:3.0:1781281094.328706:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+525:12456:x1867808064758080:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.341063:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+526:12456:x1867808064758080:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 12345us (12547us total) trans 4294975566 rc 0/0 00000100:00100000:3.0:1781281094.341081:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4727 00000100:00100000:0.0:1781281094.346775:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.347383:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758208 00000100:00100000:3.0:1781281094.347441:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4728 00000100:00100000:3.0:1781281094.347449:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+526:12455:x1867808064758208:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.347722:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+527:12455:x1867808064758208:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 272us (955us total) trans 4294975567 rc 0/0 00000100:00100000:3.0:1781281094.347730:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4728 00000100:00100000:0.0:1781281094.348296:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758336 00000100:00100000:0.0:1781281094.348335:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16319 00000100:00100000:0.0:1781281094.348339:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000529dfe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+527:12456:x1867808064758336:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.348373:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.348398:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000040bb161c/0xce40b48e7cd1996c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x209:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07d64 expref: 527 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348417:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000713bbc55/0xce40b48e7cd04838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x209:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01020 expref: 526 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348427:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003c748e1b/0xce40b48e7cd04885 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x209:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0103c expref: 525 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348438:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000a3a620e/0xce40b48e7cd003e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x209:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6e3 expref: 524 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348447:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x209:0x0].0x0 (00000000bde54e29) 00010000:00010000:0.0:1781281094.348457:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.348489:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348517:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348528:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348569:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348577:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348584:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348675:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x209:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348683:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.348689:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.352481:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].419, 64 off35008 00000040:00080000:0.0:1781281094.352536:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5011, 184 off880200 00010000:00010000:0.0:1781281094.352640:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x209:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352661:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x209:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352672:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x209:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352680:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x209:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352691:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x209:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352696:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2194f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x209:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352724:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.352743:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000529dfe6 reply state 00000000060a925f transno 4294975568 ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352790:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352795:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352801:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.352806:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6705277 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.352810:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.353045:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758464 00000100:00100000:3.0:1781281094.353094:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16320 00000100:00100000:3.0:1781281094.353100:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000976a895b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+525:12455:x1867808064758464:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.353160:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.353177:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd202f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x241:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2fd expref: 525 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353193:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a546ad98/0xce40b48e7cd07701 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x241:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01f62 expref: 524 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353205:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000590e8b3c/0xce40b48e7cd077e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x241:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01fa1 expref: 523 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353216:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038c12bff/0xce40b48e7cd01ab8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x241:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffff7 expref: 522 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353223:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x241:0x0].0x0 (0000000025f0778e) 00010000:00010000:3.0:1781281094.353231:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.353255:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353264:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353272:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353284:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x17d46a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353291:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353297:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353373:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x241:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353381:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353387:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.353730:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].420, 64 off35072 00000040:00080000:3.0:1781281094.353747:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5012, 184 off880384 00010000:00010000:3.0:1781281094.353800:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x241:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353809:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353834:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353842:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353848:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353854:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353878:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.353890:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000976a895b reply state 0000000080103a75 transno 4294975569 ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353926:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353932:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353937:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353942:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.353945:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353950:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353959:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.353962:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.353964:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.353969:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21956 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.353978:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000976a895b reply state 0000000080103a75 transno 4294975569 ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.354068:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000976a895b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12455:x1867808064758464:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 967us (4387us total) trans 4294975569 rc 0/0 00000100:00100000:3.0:1781281094.354076:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16320 00010000:00010000:2.0:1781281094.354463:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.354468:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.354477:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026aa2214 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.354479:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.354492:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.354501:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x241:0x0].0x0 (0000000028d567f6) 00010000:00010000:2.0:1781281094.354504:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.354516:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.354522:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd2196b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.354534:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.354535:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.354537:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.354639:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.354652:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:0.0:1781281094.354654:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.354658:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.354664:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2193a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.354679:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000529dfe6 reply state 00000000060a925f transno 4294975568 ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.354783:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000529dfe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12456:x1867808064758336:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 6441us (7680us total) trans 4294975568 rc 0/0 00000100:00100000:0.0:1781281094.354791:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16319 00000100:00100000:0.0:1781281094.373117:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.375572:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758592 00000100:00100000:3.0:1781281094.375642:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4729 00000100:00100000:3.0:1781281094.375649:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12455:x1867808064758592:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.375919:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+524:12455:x1867808064758592:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 270us (2805us total) trans 4294975570 rc 0/0 00000100:00100000:3.0:1781281094.375928:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4729 00000100:00100000:2.0:1781281094.383861:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.383910:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.383959:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758848 00000100:00100000:2.0:1781281094.384012:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16321 00000100:00100000:2.0:1781281094.384018:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f484cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+524:12455:x1867808064758848:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.384079:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.384110:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc266c1b/0xce40b48e7cd1f7c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09ec0 expref: 524 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384131:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd07285 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01e04 expref: 523 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384143:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae07c872/0xce40b48e7cd0737a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01e43 expref: 522 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384154:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5b91693/0xce40b48e7cd0193e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff56 expref: 521 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384164:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23d:0x0].0x0 (00000000fd773de5) 00010000:00010000:2.0:1781281094.384172:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.384201:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384214:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384224:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384237:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384243:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384248:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384342:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384349:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384359:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.384794:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].421, 64 off35136 00000040:00080000:2.0:1781281094.384815:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5013, 184 off880568 00010000:00010000:2.0:1781281094.384877:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384887:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384895:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384901:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384907:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384912:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384935:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.384955:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002f484cf7 reply state 00000000e92ffca2 transno 4294975571 ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.384996:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385002:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385008:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385013:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.385016:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385021:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.385024:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385027:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385038:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.385040:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfec5cfe already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.385042:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.385045:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385048:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385059:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.385061:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21972 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385077:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23d:0x0].0x0 (00000000174a3c69) 00000004:00010000:2.0:1781281094.385080:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002f484cf7 reply state 00000000e92ffca2 transno 4294975571 ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385081:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.385084:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385099:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21987 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.385115:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.385116:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.385118:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.385178:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f484cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+522:12455:x1867808064758848:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1158us (1267us total) trans 4294975571 rc 0/0 00000100:00100000:2.0:1781281094.385187:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16321 00000100:00100000:3.0:1781281094.392716:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.393135:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064758976 00000100:00100000:0.0:1781281094.393199:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4731 00000100:00100000:0.0:1781281094.393206:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a634b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12455:x1867808064758976:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.393467:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a634b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+524:12455:x1867808064758976:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 261us (760us total) trans 4294975573 rc 0/0 00000100:00100000:0.0:1781281094.393476:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4731 00000100:00100000:0.0:1781281094.395978:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.396051:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759104 00000100:00100000:2.0:1781281094.396098:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16322 00000100:00100000:2.0:1781281094.396104:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+524:12456:x1867808064759104:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.396153:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.396174:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd1cd8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x376:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08eeb expref: 524 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396193:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd19f0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x376:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07f2b expref: 523 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396203:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000417c2c20/0xce40b48e7cd1cdad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x376:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f00 expref: 522 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396212:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd19cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x376:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e6e expref: 521 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396218:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x376:0x0].0x0 (00000000aa054aa8) 00010000:00010000:2.0:1781281094.396224:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.396250:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396261:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396269:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396282:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396287:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396294:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396379:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x376:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396385:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396391:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.396801:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].438, 64 off36352 00000040:00080000:2.0:1781281094.396821:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5014, 184 off880752 00010000:00010000:2.0:1781281094.396882:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x376:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396891:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396898:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396905:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396911:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396921:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.396945:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.396963:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000068983bef reply state 00000000a4ec72bd transno 4294975574 ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397005:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397011:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397016:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397022:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.397024:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397030:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397038:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:2.0:1781281094.397040:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.397042:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.397048:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd2198e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.397058:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000068983bef reply state 00000000a4ec72bd transno 4294975574 ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397061:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.397068:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397077:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002530f21b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.397080:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397087:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397097:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x376:0x0].0x0 (000000006f7f2ef2) 00010000:00010000:0.0:1781281094.397100:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.397102:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397108:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd219a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x376:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.397121:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.397122:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.397124:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.397135:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+522:12456:x1867808064759104:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1029us (1160us total) trans 4294975574 rc 0/0 00000100:00100000:2.0:1781281094.397143:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16322 00000100:00100000:2.0:1781281094.398679:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.405716:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.405824:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759360 00000100:00100000:2.0:1781281094.405877:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4732 00000100:00100000:2.0:1781281094.405884:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026657b73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+522:12456:x1867808064759360:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.406143:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026657b73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12456:x1867808064759360:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 258us (434us total) trans 4294975575 rc 0/0 00000100:00100000:2.0:1781281094.406152:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4732 00000100:00100000:3.0:1781281094.407361:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759232 00000100:00100000:3.0:1781281094.407409:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16323 00000100:00100000:3.0:1781281094.407414:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+523:12455:x1867808064759232:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.407455:0:6155:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.407480:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd2061d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a423 expref: 523 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407502:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c98350b6/0xce40b48e7cd0825a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0233d expref: 522 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407525:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fc01ab63/0xce40b48e7cd082c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02359 expref: 521 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407536:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000493be758/0xce40b48e7cd01f50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001ef expref: 520 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407567:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24d:0x0].0x0 (00000000db6a744d) 00010000:00010000:3.0:1781281094.407577:0:6155:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.407606:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407619:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407703:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407719:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x76821429 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407726:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407732:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407828:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407837:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.407843:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.408191:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].422, 64 off35200 00000040:00080000:3.0:1781281094.408211:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5015, 184 off880936 00000100:00100000:2.0:1781281094.408222:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281094.408264:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408273:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408281:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408286:0:6155:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408292:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408297:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408314:0:6155:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.408330:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000062a02db7 reply state 0000000020e4d179 transno 4294975576 ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408350:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.408354:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408360:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.408363:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408370:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408378:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24d:0x0].0x0 (00000000e662b1dc) 00010000:00010000:3.0:1781281094.408381:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.408384:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408389:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd219bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408397:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.408399:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.408400:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.408432:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408439:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408444:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408450:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009743fedf already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.408453:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408458:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408465:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.408467:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.408469:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.408475:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd219aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.408483:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000062a02db7 reply state 0000000020e4d179 transno 4294975576 ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.408579:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+518:12455:x1867808064759232:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1164us (9906us total) trans 4294975576 rc 0/0 00000100:00100000:3.0:1781281094.408586:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16323 00010000:00010000:3.0:1781281094.409207:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.409210:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd219db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.409217:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c84ea5a8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.409219:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd219db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.409224:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd219db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.409232:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36a:0x0].0x0 (0000000085352b7c) 00010000:00010000:3.0:1781281094.409234:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.409236:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd219db lrc: 1/0,0 mode: --/PW res: [0x200000402:0x36a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.409241:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd219db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.409250:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.409251:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.409252:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.418979:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.418997:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x76821429 (000000001587c8f4) 00010000:00010000:2.0:1781281094.419000:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.419005:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.419011:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24d:0x0].0x0 (00000000e662b1dc) 00010000:00010000:2.0:1781281094.419013:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.419108:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759552 00000100:00100000:0.0:1781281094.419164:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4733 00000100:00100000:0.0:1781281094.419171:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+519:12456:x1867808064759552:12345-192.168.202.40@tcp:37:dbench.0 00010000:00010000:3.0:1781281094.419772:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.419785:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xa36e7a4 (000000004c9c5422) 00010000:00010000:3.0:1781281094.419788:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.419803:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.419809:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36a:0x0].0x0 (0000000085352b7c) 00010000:00010000:3.0:1781281094.419811:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.425451:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.425579:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759680 00000100:00100000:2.0:1781281094.425622:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4734 00000100:00100000:2.0:1781281094.425629:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008362d394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+521:12455:x1867808064759680:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.425868:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008362d394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+522:12455:x1867808064759680:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 238us (425us total) trans 4294975578 rc 0/0 00000100:00100000:2.0:1781281094.425875:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4734 00000100:00100000:0.0:1781281094.427686:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+520:12456:x1867808064759552:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 8510us (8801us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.427699:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4733 00000100:00100000:2.0:1781281094.448372:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.448418:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.454231:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.459063:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064759808 00000100:00100000:0.0:1781281094.459133:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760000 00000100:00100000:0.0:1781281094.459165:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16325 00000100:00100000:0.0:1781281094.459171:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5275744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+522:12455:x1867808064759808:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.459221:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.459247:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd20487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a389 expref: 522 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459271:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003a958dd0/0xce40b48e7cd0842f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c023c9 expref: 521 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459283:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000080f815e0/0xce40b48e7cd0849f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c023f3 expref: 520 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459294:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000773f3625/0xce40b48e7cd02022 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00243 expref: 519 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459304:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24f:0x0].0x0 (00000000a9f50468) 00010000:00010000:0.0:1781281094.459313:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.459340:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459354:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459365:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459377:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459384:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459389:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459498:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459533:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.459573:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.459921:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].423, 64 off35264 00000040:00080000:0.0:1781281094.459941:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5017, 184 off881304 00010000:00010000:0.0:1781281094.459999:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460009:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460016:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460023:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460028:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460034:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460052:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.460069:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c5275744 reply state 00000000bb25691b transno 4294975580 ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460114:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460121:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460128:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460134:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6705277 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.460137:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460144:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460152:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.460155:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.460157:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460163:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd219e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.460173:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c5275744 reply state 00000000bb25691b transno 4294975580 ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.460255:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5275744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+520:12455:x1867808064759808:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1082us (20894us total) trans 4294975580 rc 0/0 00000100:00100000:0.0:1781281094.460264:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16325 00000100:00100000:0.0:1781281094.460290:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16326 00000100:00100000:0.0:1781281094.460295:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e3d67b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+519:12551:x1867808064760000:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:0.0:1781281094.460307:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281094.460318:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x222:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a709 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460337:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 520 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460347:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 520 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460353:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:0.0:1781281094.460356:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.460358:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c770f98, rc 0) 00000100:00100000:0.0:1781281094.460373:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e3d67b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+520:12551:x1867808064760000:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 78us (11956us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.460379:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16326 00010000:00010000:0.0:1781281094.460403:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.460406:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460413:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.460415:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460421:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460430:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24f:0x0].0x0 (0000000011107ce7) 00010000:00010000:0.0:1781281094.460432:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.460434:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460440:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd219f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.460450:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.460452:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.460453:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281094.465642:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.465677:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.465708:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760192 00000100:00100000:0.0:1781281094.465751:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760320 00000100:00100000:0.0:1781281094.465770:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4736 00000100:00100000:0.0:1781281094.465777:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398f68c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+517:12551:x1867808064760192:12345-192.168.202.40@tcp:37:ll_sa_12456.0 00010000:00010000:2.0:1781281094.466581:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.466598:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x9e362f1b (000000007b067406) 00010000:00010000:2.0:1781281094.466601:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.466605:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.466611:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24f:0x0].0x0 (0000000011107ce7) 00010000:00010000:2.0:1781281094.466613:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.469755:0:15255:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002dda2bbc pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15255:1867808083777600:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281094.469785:0:15255:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.485015:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.492933:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760448 00000100:00100000:3.0:1781281094.492995:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16328 00000100:00100000:3.0:1781281094.493001:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+517:12455:x1867808064760448:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.493051:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.493079:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd20441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a36d expref: 517 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493104:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a505530b/0xce40b48e7cd080cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c022b1 expref: 516 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493115:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000024e76d27/0xce40b48e7cd08118 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c022cd expref: 515 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493126:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000083a2cde/0xce40b48e7cd01e77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00194 expref: 514 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493136:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24b:0x0].0x0 (00000000c07fd348) 00010000:00010000:3.0:1781281094.493146:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.493174:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493189:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493198:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493211:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x6324417e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493217:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493223:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493321:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493329:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.493339:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.494994:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].424, 64 off35328 00000040:00080000:3.0:1781281094.495022:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5018, 184 off881488 00010000:00010000:3.0:1781281094.495112:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495129:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495138:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495145:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495150:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495156:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495235:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.495258:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005b85a7e2 reply state 000000001bb1f86b transno 4294975582 ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495310:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495321:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495327:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495334:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.495337:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495344:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495354:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.495357:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.495361:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.495366:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.495375:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005b85a7e2 reply state 000000001bb1f86b transno 4294975582 ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.495477:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12455:x1867808064760448:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2473us (10466us total) trans 4294975582 rc 0/0 00000100:00100000:3.0:1781281094.495486:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16328 00000100:00100000:0.0:1781281094.497919:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.498571:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760512 00010000:00010000:3.0:1781281094.498614:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 515 pid: 14242 timeout: 717 lvb_type: 0 00000100:00100000:3.0:1781281094.498658:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4784 00000100:00100000:3.0:1781281094.498665:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+515:2269:x1867808064760512:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281094.498679:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281094.498685:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 515 pid: 14242 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.498695:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 515 pid: 14242 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.499533:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd219fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a709 expref: 515 pid: 14242 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.499585:0:6143:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:3.0:1781281094.499590:0:6143:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.499601:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.499609:0:6143:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.499641:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281094.499822:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+514:2269:x1867808064760512:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 1155us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.499831:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4784 00010000:00010000:2.0:1781281094.501679:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.501689:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.501713:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009743fedf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.501717:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.501728:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.501745:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24b:0x0].0x0 (000000007222a54c) 00010000:00010000:2.0:1781281094.501747:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.501751:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.501756:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.501772:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.501774:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.501775:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1781281094.503060:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].440, 64 off36480 00000040:00080000:0.0:1781281094.503082:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5019, 184 off881672 00010000:00010000:0.0:1781281094.503146:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503157:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503166:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503173:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503179:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503186:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503248:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.503269:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a9611f8a reply state 00000000a3d9c476 transno 4294975583 ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503317:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503323:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503328:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503333:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000397cfa67 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.503336:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503342:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503353:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:0.0:1781281094.503355:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.503359:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.503364:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000397cfa67/0xce40b48e7cd21a05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.503373:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a9611f8a reply state 00000000a3d9c476 transno 4294975583 ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.504667:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12456:x1867808064760128:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 43312us (50437us total) trans 4294975583 rc 0/0 00000100:00100000:0.0:1781281094.504681:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16327 00010000:00010000:2.0:1781281094.508947:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.508957:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0xdf197568 (0000000017993610) 00010000:00010000:2.0:1781281094.508959:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.508963:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.508968:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x228:0x0].0x0 (00000000415a95b5) 00010000:00010000:2.0:1781281094.508970:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1781281094.509139:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.509145:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.509153:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.509156:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.509163:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.509174:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x228:0x0].0x0 (00000000415a95b5) 00010000:00010000:3.0:1781281094.509175:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.509178:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.509183:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21a36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.509196:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.509197:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.509199:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281094.511228:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.511287:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.511845:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4739 00000100:00100000:0.0:1781281094.511851:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398f68c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+517:12455:x1867808064760768:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.511983:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000398f68c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+518:12455:x1867808064760768:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 131us (696us total) trans 4294975585 rc 0/0 00000100:00100000:0.0:1781281094.511991:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4739 00000100:00100000:0.0:1781281094.516563:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.516610:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.516687:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064760896 00000100:00100000:3.0:1781281094.516729:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064761024 00000100:00100000:3.0:1781281094.516757:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16329 00000100:00100000:3.0:1781281094.516764:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c9fe8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+518:12455:x1867808064760896:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.516837:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.516862:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd1fd4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x259:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a0cd expref: 518 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516890:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b5e424/0xce40b48e7cd0b417 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x259:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c034d9 expref: 517 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516902:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004c833f23/0xce40b48e7cd0b495 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x259:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0350a expref: 516 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516914:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007891273e/0xce40b48e7cd023d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x259:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003e0 expref: 515 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516925:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x259:0x0].0x0 (0000000005a25b42) 00010000:00010000:3.0:1781281094.516937:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.516966:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516981:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.516992:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517008:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xbea011c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517014:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517020:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517133:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x259:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517141:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517148:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.517473:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].425, 64 off35392 00000040:00080000:3.0:1781281094.517492:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5020, 184 off881856 00010000:00010000:3.0:1781281094.517606:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x259:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517616:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517624:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517631:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517636:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517641:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517659:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.517675:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e2c9fe8d reply state 000000004c4c024f transno 4294975586 ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517723:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517730:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517735:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517741:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009743fedf already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.517744:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517750:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517760:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.517762:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.517765:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517770:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21a3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.517778:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e2c9fe8d reply state 000000004c4c024f transno 4294975586 ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.517847:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c9fe8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+516:12455:x1867808064760896:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1082us (1307us total) trans 4294975586 rc 0/0 00000100:00100000:3.0:1781281094.517856:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16329 00000100:00100000:3.0:1781281094.517880:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16330 00000100:00100000:3.0:1781281094.517886:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a93075c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12456:x1867808064761024:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.517912:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.517925:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd05f4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x226:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c017ac expref: 515 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517939:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bbedaad4/0xce40b48e7cd00fdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbac expref: 514 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517951:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eaeca20f/0xce40b48e7cd05fd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x226:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c017d6 expref: 513 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517962:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd00fc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x226:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffba5 expref: 512 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517970:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x226:0x0].0x0 (00000000d7013489) 00010000:00010000:3.0:1781281094.517976:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.517990:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.517998:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518010:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518034:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518042:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518049:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518111:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518118:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518125:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.518366:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].441, 64 off36544 00000040:00080000:3.0:1781281094.518381:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5021, 184 off882040 00010000:00010000:3.0:1781281094.518424:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x226:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518433:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518440:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518446:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518450:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518455:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518469:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:3.0:1781281094.518480:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004a93075c reply state 00000000e87e1294 transno 4294975587 ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518528:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518534:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518572:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518578:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009f6dc9ac already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.518581:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518588:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518602:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:3.0:1781281094.518605:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.518608:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.518613:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21a59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x222:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.518622:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004a93075c reply state 00000000e87e1294 transno 4294975587 ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.518666:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a93075c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+513:12456:x1867808064761024:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 779us (2056us total) trans 4294975587 rc 0/0 00000100:00100000:3.0:1781281094.518673:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16330 00010000:00010000:0.0:1781281094.518852:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281094.518858:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518865:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007abec6b7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.518867:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518873:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518886:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x259:0x0].0x0 (0000000025f0778e) 00010000:00010000:0.0:1781281094.518889:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.518891:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518896:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21a52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518907:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.518909:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518914:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003a03766 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.518916:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518921:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518928:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x226:0x0].0x0 (000000009aa26873) 00010000:00010000:0.0:1781281094.518930:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.518931:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518936:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21a6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.518944:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.518945:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.518947:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.519449:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.527223:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.527434:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064761152 00000100:00100000:0.0:1781281094.527492:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4740 00000100:00100000:0.0:1781281094.527499:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+513:12455:x1867808064761152:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.527765:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+514:12455:x1867808064761152:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 265us (549us total) trans 4294975588 rc 0/0 00000100:00100000:0.0:1781281094.527773:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4740 00010000:00010000:2.0:1781281094.532174:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.532204:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x1e68dc46 (00000000d45dc03d) 00010000:00010000:2.0:1781281094.532207:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.532212:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.532218:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x226:0x0].0x0 (000000009aa26873) 00010000:00010000:2.0:1781281094.532220:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.536165:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.536258:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064761280 00000100:00100000:0.0:1781281094.536310:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16331 00000100:00100000:0.0:1781281094.536317:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000db70d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+514:12455:x1867808064761280:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.536371:0:15255:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.536396:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd20410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x249:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a358 expref: 514 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536428:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000279cfa51/0xce40b48e7cd07eda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x249:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c02209 expref: 513 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536442:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000984ac703/0xce40b48e7cd07f90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x249:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0223a expref: 512 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536453:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd6d320c/0xce40b48e7cd01dc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x249:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00147 expref: 511 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536462:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x249:0x0].0x0 (00000000a11cf4f5) 00010000:00010000:0.0:1781281094.536470:0:15255:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.536499:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536524:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536534:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536580:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536587:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536594:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536687:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x249:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536694:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.536701:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.537028:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].426, 64 off35456 00000040:00080000:0.0:1781281094.537048:0:15255:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5022, 184 off882224 00010000:00010000:0.0:1781281094.537105:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x249:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537114:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537123:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537129:0:15255:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537135:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537140:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537165:0:15255:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.537182:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000db70d29 reply state 00000000ceb81f22 transno 4294975589 ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537226:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537232:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537238:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537244:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6705277 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.537247:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537258:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537267:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281094.537269:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.537272:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.537278:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21a75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.537289:0:15255:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000db70d29 reply state 00000000ceb81f22 transno 4294975589 ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.537356:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000db70d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12455:x1867808064761280:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1038us (1198us total) trans 4294975589 rc 0/0 00000100:00100000:0.0:1781281094.537364:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16331 00010000:00010000:3.0:1781281094.537798:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.537804:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.537812:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd082e3d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.537815:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.537822:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.537832:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x249:0x0].0x0 (00000000a9f50468) 00010000:00010000:3.0:1781281094.537834:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.537837:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.537841:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21a8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436616321472 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.537853:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.537854:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.537855:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281094.543218:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.552894:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+513:12456:x1867808064761408:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 9522us (9673us total) trans 4294975590 rc 0/0 00000100:00100000:2.0:1781281094.552912:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4741 00000100:00100000:3.0:1781281094.560481:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.561019:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.562596:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064761536 00000100:00100000:2.0:1781281094.562650:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4742 00000100:00100000:2.0:1781281094.562654:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12455:x1867808064761536:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.562770:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+513:12455:x1867808064761536:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 115us (2297us total) trans 4294975592 rc 0/0 00000100:00100000:2.0:1781281094.562777:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4742 00010000:00010000:0.0:1781281094.566589:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.566601:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd21aa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.566617:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b4973da9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.566620:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd21aa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.566630:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd21aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.566650:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x224:0x0].0x0 (000000006f6a69a2) 00010000:00010000:0.0:1781281094.566652:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.566657:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd21aa6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.566663:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd21aa6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.566684:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.566686:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.566687:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.571134:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.571157:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0xeff62052 (00000000e4c0c214) 00010000:00010000:3.0:1781281094.571160:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.571165:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.571171:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x224:0x0].0x0 (000000006f6a69a2) 00010000:00010000:3.0:1781281094.571173:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.574890:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.575869:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064761728 00000100:00100000:0.0:1781281094.575969:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4743 00000100:00100000:0.0:1781281094.575977:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a7dbd0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12456:x1867808064761728:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:2.0:1781281094.576579:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281094.579699:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.579708:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd21ac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x247:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.579719:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000554b98e8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.579722:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd21ac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x247:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.579728:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd21ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x247:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.579741:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x247:0x0].0x0 (00000000a03c5ba5) 00010000:00010000:0.0:1781281094.579744:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.579747:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd21ac2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x247:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.579752:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd21ac2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x247:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436636363200 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.579766:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.579768:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.579769:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281094.587044:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a7dbd0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12456:x1867808064761728:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 11063us (12168us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.587055:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4743 00000100:00100000:0.0:1781281094.592011:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.597085:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.597228:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762048 00000100:00100000:3.0:1781281094.597301:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4744 00000100:00100000:3.0:1781281094.597310:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12455:x1867808064762048:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.597713:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12455:x1867808064762048:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 402us (637us total) trans 4294975594 rc 0/0 00000100:00100000:3.0:1781281094.597726:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4744 00000100:00100000:2.0:1781281094.602267:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.602306:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.602340:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.602377:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.602511:0:6159:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762432 00000100:00100000:0.0:1781281094.602569:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762240 00000100:00100000:2.0:1781281094.602596:0:6159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4745 00000100:00100000:0.0:1781281094.602596:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762112 00000100:00100000:2.0:1781281094.602604:0:6159:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f85e3586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+514:12456:x1867808064762432:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.602616:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762304 00000100:00100000:2.0:1781281094.602625:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16335 00000100:00100000:2.0:1781281094.602629:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12455:x1867808064762240:12345-192.168.202.40@tcp:36:dbench.0 00000100:00100000:0.0:1781281094.602644:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16336 00000100:00100000:0.0:1781281094.602647:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027eedfb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+515:2268:x1867808064762112:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:0.0:1781281094.602655:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281094.602677:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21ae5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a717 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602685:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.602712:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd20296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2da expref: 516 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602727:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602732:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000645e8aba/0xce40b48e7cd0b5d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03581 expref: 515 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602742:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602743:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f4ee5f2/0xce40b48e7cd0b647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c035ab expref: 514 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602754:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602757:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000526475c/0xce40b48e7cd024ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0043b expref: 513 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602768:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25b:0x0].0x0 (00000000639c27f1) 00010000:00010000:0.0:1781281094.602770:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.602779:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.602780:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602785:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602899:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602908:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602915:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.602943:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16337 00000004:00200000:0.0:1781281094.602945:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1781281094.602948:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d183d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+512:2268:x1867808064762304:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:3.0:1781281094.602956:0:15255:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281094.602965:0:15255:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21b01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a71e expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.602965:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602976:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602985:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.602991:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602991:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.602999:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603000:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603020:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603032:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603039:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603044:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603093:0:15255:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603102:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603109:0:15255:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281094.603127:0:15255:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1fd:0x0]: returning size 260096 00000004:00200000:3.0:1781281094.603129:0:15255:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281094.603138:0:15255:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.603146:0:15255:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603266:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603277:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603283:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603295:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603301:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603306:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603358:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603365:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603371:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.603883:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].429, 64 off35648 00000040:00080000:2.0:1781281094.603902:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5025, 184 off882776 00010000:00010000:2.0:1781281094.603967:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603977:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603984:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603991:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.603997:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604003:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604035:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.604052:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000087a7dbbf reply state 00000000a4882b12 transno 4294975595 ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604105:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604111:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604117:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604122:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.604126:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604132:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604143:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.604145:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.604149:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604154:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.604163:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000087a7dbbf reply state 00000000a4882b12 transno 4294975595 ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.604256:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12455:x1867808064762240:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1623us (1995us total) trans 4294975595 rc 0/0 00000100:00100000:2.0:1781281094.604264:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16335 00010000:00010000:2.0:1781281094.604301:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.604305:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604311:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e3cd91b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.604313:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604319:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604327:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25b:0x0].0x0 (00000000bebabaf2) 00010000:00010000:2.0:1781281094.604329:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.604331:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604336:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.604344:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.604345:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.604347:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.604959:0:6159:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f85e3586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12456:x1867808064762432:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 2353us (2580us total) trans 4294975596 rc 0/0 00000100:00100000:2.0:1781281094.604968:0:6159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4745 00010000:00010000:0.0:1781281094.608724:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.608738:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608755:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608772:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:0.0:1781281094.608775:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.608781:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608788:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21aec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608887:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608894:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608899:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608905:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d07fc1c6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.608907:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608911:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608920:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x7ee78a8d (0000000079f1dc38) 00010000:00010000:0.0:1781281094.608922:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.608925:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608930:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21af3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608976:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21ae5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a717 expref: 515 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608991:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a717 expref: 514 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.608997:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (000000003886c019) 00010000:00010000:0.0:1781281094.608999:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281094.609001:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002aa2c9c9, rc 0) 00000100:00100000:0.0:1781281094.609071:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027eedfb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+514:2268:x1867808064762112:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 6421us (6764us total) trans 0 rc 0/0 00010000:00010000:3.0:1781281094.609081:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.609082:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16336 00010000:00010000:3.0:1781281094.609089:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609095:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609099:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003a03766 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.609101:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609107:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609116:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:3.0:1781281094.609118:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.609120:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609125:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003a03766/0xce40b48e7cd21b08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609136:0:15255:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609142:0:15255:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609148:0:15255:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609153:0:15255:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007abec6b7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.609154:0:15255:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609160:0:15255:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609167:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x204a7f30 (0000000083867f3d) 00010000:00010000:3.0:1781281094.609169:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.609171:0:15255:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609176:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007abec6b7/0xce40b48e7cd21b0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609213:0:15255:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd21b01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a71e expref: 514 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609230:0:15255:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a71e expref: 513 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.609236:0:15255:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fd:0x0].0x0 (00000000ffb54c4a) 00010000:00010000:3.0:1781281094.609237:0:15255:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1781281094.609239:0:15255:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ad6e01b4, rc 0) 00010000:00010000:2.0:1781281094.617156:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.617179:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xa3962d5b (00000000758c336a) 00010000:00010000:2.0:1781281094.617182:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.617187:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.617194:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25b:0x0].0x0 (00000000bebabaf2) 00010000:00010000:2.0:1781281094.617195:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.619776:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762560 00000100:00100000:2.0:1781281094.619899:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4746 00000100:00100000:2.0:1781281094.619907:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+515:12455:x1867808064762560:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.620131:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16338 00000100:00100000:3.0:1781281094.620136:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016840e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+516:12456:x1867808064762688:12345-192.168.202.40@tcp:36:dbench.0 00000100:00100000:2.0:1781281094.620136:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+516:12455:x1867808064762560:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 229us (1075us total) trans 4294975597 rc 0/0 00000100:00100000:2.0:1781281094.620144:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4746 00010000:00010000:3.0:1781281094.620164:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281094.620202:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd21ade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a710 expref: 515 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620220:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005276f645/0xce40b48e7cd03fe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00d6b expref: 514 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620230:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d261ebca/0xce40b48e7cd04027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00d87 expref: 513 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620240:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005be09fc2/0xce40b48e7ccffdca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff482 expref: 512 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620249:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fb:0x0].0x0 (00000000c8c7ecfb) 00010000:00010000:3.0:1781281094.620262:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f1025eef/0xce40b48e7cd2146a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6df expref: 511 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620269:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:3.0:1781281094.620273:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.620300:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620313:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620323:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620339:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620346:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.620352:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.620897:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d183d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+510:2268:x1867808064762304:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 17945us (18554us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.620905:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16337 00010000:00010000:3.0:1781281094.623575:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.623604:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.623620:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.624096:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].430, 64 off35712 00000040:00080000:3.0:1781281094.624118:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5026, 184 off882960 00010000:00010000:3.0:1781281094.624193:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624203:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624211:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624218:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624224:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624230:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624265:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.624285:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000016840e06 reply state 00000000b73c22bc transno 4294975598 ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624331:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624337:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624342:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624348:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067a58f76 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.624352:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624358:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624369:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:3.0:1781281094.624371:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.624375:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.624380:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd21b39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.624389:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000016840e06 reply state 00000000b73c22bc transno 4294975598 ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.626332:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762816 00000100:00100000:2.0:1781281094.626383:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16339 00000100:00100000:2.0:1781281094.626389:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d21c3b02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12455:x1867808064762816:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.626441:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.626466:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003f8003e4/0xce40b48e7cd202ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a2ef expref: 512 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626486:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006eed228b/0xce40b48e7cd074bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01eb3 expref: 511 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626499:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004ef58a6b/0xce40b48e7cd07510 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01ed6 expref: 510 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626520:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004ecb629b/0xce40b48e7cd01a02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffaa expref: 509 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626530:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23f:0x0].0x0 (000000005d3a9d9e) 00010000:00010000:2.0:1781281094.626538:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.626592:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626607:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626617:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626648:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x1674e29a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626654:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626660:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626759:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626773:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.626780:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.627164:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].431, 64 off35776 00000040:00080000:2.0:1781281094.627185:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5027, 184 off883144 00010000:00010000:2.0:1781281094.627249:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627259:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627266:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627272:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627277:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627282:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627304:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:2.0:1781281094.627334:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d21c3b02 reply state 00000000e91fe1ec transno 4294975599 ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627385:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627391:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627396:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627402:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e3cd91b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.627405:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627412:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627421:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.627424:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.627427:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.627433:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.627441:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d21c3b02 reply state 00000000e91fe1ec transno 4294975599 ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.627486:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016840e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12456:x1867808064762688:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 7348us (8347us total) trans 4294975598 rc 0/0 00000100:00100000:2.0:1781281094.627515:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d21c3b02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12455:x1867808064762816:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1125us (1521us total) trans 4294975599 rc 0/0 00000100:00100000:3.0:1781281094.627722:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16338 00010000:00010000:0.0:1781281094.629267:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281094.629278:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629296:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdfff942 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.629300:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629308:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629324:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fb:0x0].0x0 (0000000090c37552) 00010000:00010000:0.0:1781281094.629326:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.629330:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629335:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd21b4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629349:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.629352:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629357:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833fb648 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.629358:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629363:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629369:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23f:0x0].0x0 (0000000066f5f2ee) 00010000:00010000:0.0:1781281094.629371:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.629373:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629377:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21b6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.629385:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.629386:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.629387:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.629393:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281094.632007:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16339 00000100:00100000:2.0:1781281094.633298:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.633402:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064762944 00000100:00100000:3.0:1781281094.633463:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16340 00000100:00100000:3.0:1781281094.633470:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42aef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12456:x1867808064762944:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.633536:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1781281094.633581:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21afa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a717 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633601:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d46e72d/0xce40b48e7cd20b6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3af:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5d5 expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633615:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (000000003886c019) 00010000:00010000:3.0:1781281094.633631:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.633661:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633674:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633682:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633696:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633702:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633708:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633808:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633816:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.633823:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281094.634176:0:6157:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x3af:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1781281094.634240:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5028, 176 off883320 00000004:00010000:3.0:1781281094.634313:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f42aef7d reply state 00000000da351e92 transno 4294975600 ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634323:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634329:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634335:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634340:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000244f2dcd already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.634343:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634349:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634357:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:3.0:1781281094.634359:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.634362:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.634367:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21b71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.634382:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f42aef7d reply state 00000000da351e92 transno 4294975600 ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.634464:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42aef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12456:x1867808064762944:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 993us (1171us total) trans 4294975600 rc 0/0 00000100:00100000:3.0:1781281094.634472:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16340 00010000:00010000:3.0:1781281094.637334:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.637355:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x1674e29a (00000000d3edfa01) 00010000:00010000:3.0:1781281094.637358:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.637363:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.637369:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23f:0x0].0x0 (0000000066f5f2ee) 00010000:00010000:3.0:1781281094.637371:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.641741:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.644654:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763072 00000100:00100000:0.0:1781281094.644719:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4747 00000100:00100000:0.0:1781281094.644726:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12456:x1867808064763072:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.645020:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12456:x1867808064763072:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 294us (3288us total) trans 4294975601 rc 0/0 00000100:00100000:0.0:1781281094.645029:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4747 00000100:00100000:2.0:1781281094.645660:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.645734:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763200 00000100:00100000:0.0:1781281094.645762:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4748 00000100:00100000:0.0:1781281094.645767:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da6e95ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12455:x1867808064763200:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.645890:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da6e95ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12455:x1867808064763200:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 122us (232us total) trans 4294975602 rc 0/0 00000100:00100000:0.0:1781281094.645898:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4748 00000100:00100000:3.0:1781281094.652457:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.652521:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.652853:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763328 00000100:00100000:2.0:1781281094.652909:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763456 00000100:00100000:2.0:1781281094.653019:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16341 00000100:00100000:2.0:1781281094.653026:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12456:x1867808064763328:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.653083:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.653111:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd21b16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a71e expref: 512 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653130:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071838ab4/0xce40b48e7cd041f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00e1a expref: 511 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653142:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d80d7073/0xce40b48e7cd0421f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00e2f expref: 510 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653152:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7ccffedb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4eb expref: 509 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653161:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fd:0x0].0x0 (00000000ffb54c4a) 00010000:00010000:2.0:1781281094.653172:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.653200:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653213:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653224:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653238:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653245:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653250:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653356:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653364:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653371:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.653760:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].432, 64 off35840 00000040:00080000:2.0:1781281094.653780:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5029, 184 off883504 00010000:00010000:2.0:1781281094.653841:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653851:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653859:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653867:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653874:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653880:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653897:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.653914:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ea5ecdfc reply state 0000000014df04f7 transno 4294975603 ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653933:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.653936:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653942:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000031c8d5c8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.653945:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653951:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653959:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fd:0x0].0x0 (000000005d3a9d9e) 00010000:00010000:2.0:1781281094.653961:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.653964:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653975:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21b9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.653985:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.653986:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.653987:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.654024:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654030:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654036:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654041:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e3cd91b already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.654044:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654050:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654057:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:2.0:1781281094.654059:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.654061:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654067:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21b86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.654080:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ea5ecdfc reply state 0000000014df04f7 transno 4294975603 ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.654161:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12456:x1867808064763328:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1133us (1711us total) trans 4294975603 rc 0/0 00000100:00100000:2.0:1781281094.654169:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16341 00000100:00100000:2.0:1781281094.654196:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16342 00000100:00100000:2.0:1781281094.654202:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df9eb1f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12455:x1867808064763456:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.654231:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.654244:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008299ecf1/0xce40b48e7cd1f94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x395:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09f53 expref: 509 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654257:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac7232e7/0xce40b48e7cd1ce5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x395:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f46 expref: 508 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654268:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd1f990 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x395:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09f6f expref: 507 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654278:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a6ecdfd/0xce40b48e7cd1cd44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x395:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08ecf expref: 506 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654285:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x395:0x0].0x0 (00000000cd8f5088) 00010000:00010000:2.0:1781281094.654291:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.654307:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654321:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654328:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654340:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x5a114248 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654346:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654351:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654411:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x395:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654419:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654425:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.654699:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].433, 64 off35904 00000040:00080000:2.0:1781281094.654712:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5030, 184 off883688 00010000:00010000:2.0:1781281094.654754:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x395:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654763:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654771:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654777:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654783:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654789:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654811:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.654824:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df9eb1f7 reply state 0000000054aa42bc transno 4294975604 ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654855:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654861:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654866:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654871:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833fb648 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.654873:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654884:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654893:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:2.0:1781281094.654895:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.654898:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.654903:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21ba2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.654912:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000df9eb1f7 reply state 0000000054aa42bc transno 4294975604 ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.654956:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df9eb1f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12455:x1867808064763456:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 753us (2434us total) trans 4294975604 rc 0/0 00000100:00100000:2.0:1781281094.654963:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16342 00010000:00010000:0.0:1781281094.662641:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.662652:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.662667:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfec5cfe already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.662671:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.662680:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.662699:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x395:0x0].0x0 (00000000639c27f1) 00010000:00010000:0.0:1781281094.662702:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.662706:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.662712:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21bb7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x395:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.662730:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.662732:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.662733:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.677450:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.677474:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x204a7f30 (00000000824a8c95) 00010000:00010000:3.0:1781281094.677477:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.677482:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.677488:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fd:0x0].0x0 (000000005d3a9d9e) 00010000:00010000:3.0:1781281094.677490:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.690388:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.692642:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763584 00000100:00100000:2.0:1781281094.692740:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16343 00000100:00100000:2.0:1781281094.692747:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa625ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12456:x1867808064763584:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.692840:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281094.692871:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004eec315/0xce40b48e7cd20ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5a4 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692895:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (00000000443c972a) 00010000:00010000:2.0:1781281094.692905:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.692940:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692957:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692967:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692981:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692987:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.692991:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693098:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693106:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693112:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281094.693432:0:6157:0:(mdd_dir.c:1578:mdd_finish_unlink()) Object [0x200000402:0x3ad:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1781281094.693479:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5031, 184 off883872 00000004:00010000:2.0:1781281094.693622:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000aa625ebd reply state 0000000011a0e55d transno 4294975605 ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693639:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693645:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693650:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693656:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833fb648 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.693659:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693666:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693675:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:2.0:1781281094.693678:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.693681:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.693686:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21bbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.693695:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000aa625ebd reply state 0000000011a0e55d transno 4294975605 ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.693780:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa625ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12456:x1867808064763584:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1032us (3400us total) trans 4294975605 rc 0/0 00000100:00100000:2.0:1781281094.693791:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16343 00000100:00100000:2.0:1781281094.702271:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.702334:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.702369:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763712 00000100:00100000:2.0:1781281094.702412:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763776 00000100:00100000:2.0:1781281094.702432:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4749 00000100:00100000:2.0:1781281094.702437:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d04220b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12455:x1867808064763712:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281094.702696:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d04220b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12455:x1867808064763712:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 257us (429us total) trans 4294975606 rc 0/0 00000100:00100000:2.0:1781281094.702705:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4749 00000100:00100000:2.0:1781281094.702760:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4750 00000100:00100000:2.0:1781281094.702764:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd93a1d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12456:x1867808064763776:12345-192.168.202.40@tcp:37:dbench.0 00010000:00010000:2.0:1781281094.703576:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.703591:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x1e68dc46 (000000008937527c) 00010000:00010000:2.0:1781281094.703594:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.703599:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.703605:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (0000000062e104fb) 00010000:00010000:2.0:1781281094.703608:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.711283:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.711493:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763904 00000100:00100000:3.0:1781281094.711592:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16344 00000100:00100000:3.0:1781281094.711598:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12455:x1867808064763904:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.711657:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.711684:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005f40042/0xce40b48e7cd1f744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x239:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09e8f expref: 511 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711705:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b97ca733/0xce40b48e7cd06f2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x239:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01cc9 expref: 510 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711721:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd07039 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x239:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01d32 expref: 509 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711732:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e74afc27/0xce40b48e7cd017b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x239:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffeae expref: 508 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711740:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x239:0x0].0x0 (00000000b3d14d67) 00010000:00010000:3.0:1781281094.711749:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.711779:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711793:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711803:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711816:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711823:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711828:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711927:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x239:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711936:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.711943:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.712388:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].434, 64 off35968 00000040:00080000:3.0:1781281094.712407:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5032, 184 off884056 00010000:00010000:3.0:1781281094.712470:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x239:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712480:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712488:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712495:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712515:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712520:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd21be8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712568:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.712586:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bd0b7d5e reply state 00000000a30994a1 transno 4294975607 ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712633:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712639:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712645:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712650:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000244f2dcd already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.712652:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712657:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712666:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:3.0:1781281094.712669:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.712672:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.712678:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x235:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.712686:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bd0b7d5e reply state 00000000a30994a1 transno 4294975607 ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.712774:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12455:x1867808064763904:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1173us (1497us total) trans 4294975607 rc 0/0 00000100:00100000:3.0:1781281094.712783:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16344 00000100:00100000:0.0:1781281094.715876:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd93a1d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12456:x1867808064763776:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 13101us (13534us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.715894:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4750 00010000:00010000:0.0:1781281094.720583:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.720608:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x5e0db83a (0000000023cedac3) 00010000:00010000:0.0:1781281094.720612:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.720618:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.720626:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x239:0x0].0x0 (00000000bb6caf05) 00010000:00010000:0.0:1781281094.720628:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.732900:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064763968 00000100:00100000:0.0:1781281094.732958:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4751 00000100:00100000:0.0:1781281094.732964:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12455:x1867808064763968:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:3.0:1781281094.735926:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1781281094.735950:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f85e3586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1781281094.736029:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281094.736062:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b4c7326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1781281094.736086:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281094.736125:0:6161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777664 00000100:00100000:2.0:1781281094.736175:0:6161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1781281094.736180:0:6161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7769086 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083777664:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1781281094.736215:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061a0178c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083777792:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1781281094.736216:0:6161:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:3.0:1781281094.736239:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281094.736251:0:6161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7769086 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083777664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.736259:0:6161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1781281094.736276:0:6161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777792 00000100:00100000:3.0:1781281094.736278:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f85e3586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083777664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1781281094.736291:0:6161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1781281094.736294:0:6161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba456b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083777792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1781281094.736313:0:6161:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2259156992 avail 2257059840 00000100:00100000:2.0:1781281094.736351:0:6161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba456b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083777792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.736357:0:6161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1781281094.736453:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061a0178c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083777792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1781281094.737735:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083777728 00000100:00100000:0.0:1781281094.737779:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1781281094.737784:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f49025c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3178:x1867808083777728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1781281094.737806:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3834642432 avail 3832545280 00000100:00100000:0.0:1781281094.737878:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f49025c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3178:x1867808083777728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.737885:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:2.0:1781281094.737999:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281094.740435:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12455:x1867808064763968:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 7466us (8447us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.740450:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4751 00000100:00100000:0.0:1781281094.753868:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.755655:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.755697:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.755762:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764160 00000100:00100000:3.0:1781281094.755831:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16345 00000100:00100000:3.0:1781281094.755837:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12555:x1867808064764160:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:3.0:1781281094.755871:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281094.755894:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a725 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.755937:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.755951:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.755960:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:3.0:1781281094.755962:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.755965:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000244f2dcd, rc 0) 00000100:00100000:3.0:1781281094.756022:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12555:x1867808064764160:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 183us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.756029:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16345 00000100:00100000:0.0:1781281094.758250:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.758296:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.758356:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764352 00000100:00100000:3.0:1781281094.758403:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16346 00000100:00100000:3.0:1781281094.758409:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12557:x1867808064764352:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:3.0:1781281094.758427:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281094.758452:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a72c expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.758487:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 509 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.760678:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 509 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.760696:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000b7eeb9bd) 00010000:00010000:3.0:1781281094.760700:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.760703:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ca72b92a, rc 0) 00000100:00100000:3.0:1781281094.760788:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12557:x1867808064764352:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 2377us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.760798:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16346 00000100:00100000:2.0:1781281094.763343:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764096 00000100:00100000:0.0:1781281094.773928:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.776856:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764416 00000100:00100000:3.0:1781281094.776909:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4752 00000100:00100000:3.0:1781281094.776917:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12456:x1867808064764096:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.777170:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12456:x1867808064764096:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 253us (23311us total) trans 4294975608 rc 0/0 00000100:00100000:3.0:1781281094.777179:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4752 00000100:00100000:3.0:1781281094.777198:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4753 00000100:00100000:3.0:1781281094.777202:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12455:x1867808064764288:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.777281:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+512:12455:x1867808064764288:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 78us (21584us total) trans 4294975609 rc 0/0 00000100:00100000:3.0:1781281094.777288:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4753 00000100:00100000:3.0:1781281094.777303:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4754 00000100:00100000:3.0:1781281094.777308:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018ffc263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12555:x1867808064764416:12345-192.168.202.40@tcp:37:ll_sa_12456.0 00000100:00100000:0.0:1781281094.783318:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018ffc263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12555:x1867808064764416:12345-192.168.202.40@tcp:37:ll_sa_12456.0 Request processed in 6001us (25014us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.783335:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4754 00000100:00100000:0.0:1781281094.783400:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764480 00000100:00100000:0.0:1781281094.783428:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4755 00000100:00100000:0.0:1781281094.783432:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12557:x1867808064764480:12345-192.168.202.40@tcp:37:ll_sa_12455.0 00000100:00100000:3.0:1781281094.794115:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764608 00000100:00100000:3.0:1781281094.794210:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16347 00000100:00100000:3.0:1781281094.794217:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c38bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+513:12455:x1867808064764608:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.794276:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281094.794303:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f59ba288/0xce40b48e7cd0ba8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x261:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03741 expref: 513 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794338:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ddfb6fb0/0xce40b48e7cd02722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x261:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00514 expref: 512 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794352:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6a9a985/0xce40b48e7cd0bad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x261:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0375d expref: 511 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794364:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f4adcf1/0xce40b48e7cd026f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x261:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00506 expref: 510 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794373:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x261:0x0].0x0 (000000001708121e) 00010000:00010000:3.0:1781281094.794388:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058d3e14b/0xce40b48e7cd21280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6ae expref: 509 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794395:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000b7eeb9bd) 00010000:00010000:3.0:1781281094.794398:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281094.794433:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794449:0:14242:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794457:0:14242:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.794493:0:14242:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.795316:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764736 00000100:00100000:2.0:1781281094.795348:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764864 00000100:00100000:2.0:1781281094.795358:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764800 00000100:00100000:2.0:1781281094.795370:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16348 00000100:00100000:2.0:1781281094.795374:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de5b0821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12456:x1867808064764736:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.795405:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1781281094.795423:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd1ac66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c083a7 expref: 511 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.795438:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd03c45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00c3e expref: 510 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.795449:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd03cca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00c68 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.795464:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7ccffc49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3f6 expref: 508 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.795473:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f7:0x0].0x0 (00000000e0df90c8) 00010000:00010000:2.0:1781281094.795486:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd2144e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a6e6 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.795494:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00000100:00100000:0.0:1781281094.795733:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16349 00000100:00100000:0.0:1781281094.795739:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000506bba3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+506:2270:x1867808064764864:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:0.0:1781281094.795749:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281094.795764:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21c04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a73a expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.795813:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.796048:0:14242:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 507 pid: 6157 timeout: 717 lvb_type: 0 00000100:00100000:3.0:1781281094.796622:0:14242:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000499d901d pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14242:1867808083777856:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281094.796654:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16350 00000100:00100000:3.0:1781281094.796659:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000488d7db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:2270:x1867808064764800:12345-192.168.202.40@tcp:101:ll_sa_12456.0 00010000:00010000:3.0:1781281094.796671:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281094.796685:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a733 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.796856:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.796932:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.796954:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.799529:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.799576:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.799606:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.799615:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.799692:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800593:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800609:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800617:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281094.800740:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x37c:0x0]: returning size 19054 00000004:00200000:0.0:1781281094.800744:0:6157:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281094.800765:0:6157:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800776:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800784:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800859:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800866:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800872:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d07fc1c6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.800875:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800883:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800896:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:0.0:1781281094.800899:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.800903:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800909:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800928:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800936:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800941:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800946:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.800947:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800952:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800958:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x17610ee3 (0000000079f1dc38) 00010000:00010000:0.0:1781281094.800960:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.800962:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.800967:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.801003:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21c04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a73a expref: 509 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.801019:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a73a expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.801029:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (000000000eec574b) 00010000:00010000:0.0:1781281094.801031:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1781281094.801032:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000076930d14, rc 0) 00010000:00010000:3.0:1781281094.801182:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801204:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801223:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801229:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801235:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.801276:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000506bba3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:2270:x1867808064764864:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 5534us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.801286:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16349 00010000:00010000:3.0:1781281094.801303:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x384:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801317:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x384:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801323:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x384:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281094.801341:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x384:0x0]: returning size 14984 00000004:00200000:3.0:1781281094.801343:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281094.801353:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x384:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801359:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x384:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801364:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801369:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801374:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801377:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee49ae7f already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.801379:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801384:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801394:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:3.0:1781281094.801396:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.801398:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801402:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801411:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801416:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801420:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801425:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dcd1d4b2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.801427:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801432:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801438:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x220bffe4 (0000000067b3c4de) 00010000:00010000:3.0:1781281094.801440:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.801442:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801450:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801471:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a733 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801480:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x384:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a733 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.801487:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (000000009ecb2db0) 00010000:00010000:3.0:1781281094.801488:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1781281094.801490:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f55ef574, rc 0) 00000100:00100000:3.0:1781281094.801524:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000488d7db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:2270:x1867808064764800:12345-192.168.202.40@tcp:101:ll_sa_12456.0 Request processed in 4864us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.801531:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16350 00000100:00100000:3.0:1781281094.801608:0:14242:0:(client.c:2500:ptlrpc_set_wait()) set 00000000377f296e going to sleep for 43 seconds 00010000:00010000:2.0:1781281094.802044:0:8297:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 505 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.802054:0:8297:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.802090:0:8297:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 505 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.802100:0:8297:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 505 pid: 6157 timeout: 717 lvb_type: 0 00000100:00100000:2.0:1781281094.802114:0:8297:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edb9479b pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083777920:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281094.802148:0:8297:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d3d14188 going to sleep for 43 seconds 00000100:00100000:0.0:1781281094.803534:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12557:x1867808064764480:12345-192.168.202.40@tcp:37:ll_sa_12455.0 Request processed in 20093us (29608us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.803570:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4755 00000100:00100000:3.0:1781281094.813377:0:14242:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000499d901d pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14242:1867808083777856:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281094.813408:0:14242:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.819372:0:8297:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edb9479b pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8297:1867808083777920:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281094.819408:0:8297:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.830336:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.832743:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764928 00010000:00010000:3.0:1781281094.834557:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd21bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a72c expref: 505 pid: 6157 timeout: 717 lvb_type: 0 00000100:00100000:3.0:1781281094.835509:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765056 00000100:00100000:3.0:1781281094.835584:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 680 00000100:00100000:3.0:1781281094.835590:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082bf1598 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:2269:x1867808064765056:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281094.835601:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281094.835684:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a73a expref: 504 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835702:0:6143:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (000000000eec574b) 00010000:00010000:3.0:1781281094.835706:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281094.835734:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082bf1598 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:2269:x1867808064765056:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 144us (13656us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.835741:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 680 00010000:00010000:3.0:1781281094.835799:0:14242:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835807:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835829:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835840:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835849:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835967:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835975:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.835986:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.836363:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].442, 64 off36608 00000004:00080000:3.0:1781281094.836370:0:14242:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 617540828206ns, next at 618540825496ns, rc = 0 00000040:00080000:3.0:1781281094.836390:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5033, 184 off884240 00010000:00010000:3.0:1781281094.838963:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.838986:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.838997:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839005:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839010:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839015:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839042:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.839064:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e1c38bd9 reply state 0000000081e3fe27 transno 4294975610 ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839119:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839126:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839131:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839136:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a05a721c already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.839139:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839145:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839157:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000b7eeb9bd) 00010000:00010000:3.0:1781281094.839160:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.839163:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.839168:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21bfd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x25f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.839178:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e1c38bd9 reply state 0000000081e3fe27 transno 4294975610 ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.839304:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c38bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12455:x1867808064764608:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 45084us (52648us total) trans 4294975610 rc 0/0 00000100:00100000:3.0:1781281094.839314:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16347 00010000:00010000:0.0:1781281094.840661:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.840670:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.840681:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee49ae7f already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.840684:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.840692:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.840706:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x261:0x0].0x0 (00000000fc034e3c) 00010000:00010000:0.0:1781281094.840708:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.840711:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.840717:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd21c51 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.840734:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.840736:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.840737:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281094.842602:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064764992 00010000:00010000:3.0:1781281094.842670:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 504 pid: 6157 timeout: 717 lvb_type: 0 00000100:00100000:3.0:1781281094.842712:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4786 00000100:00100000:3.0:1781281094.842718:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:2268:x1867808064764992:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281094.842733:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281094.842739:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 504 pid: 6157 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.842750:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 504 pid: 6157 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.842771:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a725 expref: 504 pid: 6157 timeout: 717 lvb_type: 0 00010000:00010000:3.0:1781281094.842787:0:9361:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:3.0:1781281094.842792:0:9361:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.842802:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.842809:0:9361:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.842844:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281094.842898:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:2268:x1867808064764992:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 180us (12572us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281094.842906:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4786 00010000:00010000:2.0:1781281094.843341:0:8297:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.843351:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.843376:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.843386:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.843395:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.844297:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281094.844313:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.844325:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.844333:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.844393:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765120 00000100:00100000:0.0:1781281094.844445:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 681 00000100:00100000:0.0:1781281094.844450:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000499d901d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+503:2269:x1867808064765120:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1781281094.844461:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281094.844477:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd21c3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x384:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a733 expref: 503 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.844490:0:6142:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (000000009ecb2db0) 00010000:00010000:0.0:1781281094.844494:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:2.0:1781281094.845775:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].435, 64 off36032 00000040:00080000:2.0:1781281094.846138:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5034, 184 off884424 00010000:00010000:2.0:1781281094.846294:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846311:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846321:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846328:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846333:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846339:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846363:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.846383:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000de5b0821 reply state 00000000d1489178 transno 4294975611 ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846436:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846442:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846447:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846452:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833fb648 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.846456:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846461:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846472:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:2.0:1781281094.846475:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.846478:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.846484:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.846492:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000de5b0821 reply state 00000000d1489178 transno 4294975611 ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.846733:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000499d901d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+503:2269:x1867808064765120:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 2279us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.846745:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 681 00000100:00100000:0.0:1781281094.853594:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765184 00000100:00100000:0.0:1781281094.853856:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4756 00000100:00100000:0.0:1781281094.853863:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12455:x1867808064765184:12345-192.168.202.40@tcp:37:dbench.0 00000100:00100000:2.0:1781281094.855366:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de5b0821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12456:x1867808064764736:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 59983us (60222us total) trans 4294975611 rc 0/0 00000100:00100000:2.0:1781281094.855380:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16348 00010000:00010000:2.0:1781281094.855425:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.855432:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855444:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ad51d6c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.855448:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855458:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855479:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f7:0x0].0x0 (00000000096db458) 00010000:00010000:2.0:1781281094.855482:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281094.855487:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855493:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855813:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.855815:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.855816:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.855832:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855841:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0xdde1c156 (0000000067b3c4de) 00010000:00010000:2.0:1781281094.855843:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.855846:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.855852:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x261:0x0].0x0 (00000000fc034e3c) 00010000:00010000:2.0:1781281094.855855:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.857752:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765440 00000100:00100000:2.0:1781281094.857778:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:2.0:1781281094.857781:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2268:x1867808064765440:12345-192.168.202.40@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1781281094.857824:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2268:x1867808064765440:12345-192.168.202.40@tcp:400:kworker/u8:0.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281094.857832:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:0.0:1781281094.863686:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.863740:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765376 00000100:00100000:0.0:1781281094.863789:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:0.0:1781281094.863796:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a285b906-59a1-4d21-bb2d-09007a70ac15+74:2268:x1867808064765376:12345-192.168.202.40@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781281094.863856:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0dfc8c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a285b906-59a1-4d21-bb2d-09007a70ac15+74:2268:x1867808064765376:12345-192.168.202.40@tcp:400:kworker/u8:0.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.863867:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:0.0:1781281094.864672:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12455:x1867808064765184:12345-192.168.202.40@tcp:37:dbench.0 Request processed in 10807us (13321us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.864683:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4756 00010000:00010000:0.0:1781281094.864741:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.864754:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x8344d724 (000000004530a32e) 00010000:00010000:0.0:1781281094.864758:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.864762:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.864767:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f7:0x0].0x0 (00000000096db458) 00010000:00010000:0.0:1781281094.864769:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.867726:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765312 00000100:00100000:0.0:1781281094.868868:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 545 00000100:00100000:0.0:1781281094.868878:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ebd54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2268:x1867808064765312:12345-192.168.202.40@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781281094.868983:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ebd54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2268:x1867808064765312:12345-192.168.202.40@tcp:400:kworker/u8:0.0 Request processed in 106us (11582us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.868992:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 545 00000100:00100000:0.0:1781281094.870272:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765568 00000100:00100000:0.0:1781281094.870318:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4757 00000100:00100000:0.0:1781281094.870323:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12456:x1867808064765568:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.870741:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12456:x1867808064765568:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 416us (843us total) trans 4294975612 rc 0/0 00000100:00100000:0.0:1781281094.870750:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4757 00000100:00100000:3.0:1781281094.874090:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765696 00000100:00100000:3.0:1781281094.874149:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4758 00000100:00100000:3.0:1781281094.874156:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12455:x1867808064765696:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.874390:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12455:x1867808064765696:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 233us (580us total) trans 4294975613 rc 0/0 00000100:00100000:3.0:1781281094.874397:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4758 00000100:00100000:0.0:1781281094.875921:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765760 00000100:00100000:0.0:1781281094.875961:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064765888 00000100:00100000:0.0:1781281094.875983:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16351 00000100:00100000:0.0:1781281094.875988:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061a0178c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12559:x1867808064765760:12345-192.168.202.40@tcp:101:ll_sa_12455.0 00010000:00010000:0.0:1781281094.876004:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281094.876022:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21c6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a741 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876055:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21c6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a741 expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876069:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd21c6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a741 expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876077:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:0.0:1781281094.876080:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.876083:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6705277, rc 0) 00000100:00100000:0.0:1781281094.876117:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061a0178c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12559:x1867808064765760:12345-192.168.202.40@tcp:101:ll_sa_12455.0 Request processed in 129us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.876123:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16351 00000100:00100000:0.0:1781281094.876138:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16352 00000100:00100000:0.0:1781281094.876141:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12456:x1867808064765888:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.876173:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.876189:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd1d28b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x384:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c090d5 expref: 506 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876209:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd1d27d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x384:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c090ce expref: 505 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876221:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd1d299 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x384:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c090dc expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876232:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd1b7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x384:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08766 expref: 503 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876240:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (000000009ecb2db0) 00010000:00010000:0.0:1781281094.876246:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.876274:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876284:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876292:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876307:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876313:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.876319:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.877571:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x384:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.877593:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.877602:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.878074:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].443, 64 off36672 00000040:00080000:0.0:1781281094.878094:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5035, 176 off884600 00010000:00010000:0.0:1781281094.878154:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x384:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878165:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878171:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878178:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878183:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878189:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878212:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281094.878232:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a3fd5a1 reply state 000000001a6702b4 transno 4294975614 ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878264:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.878270:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878276:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000076930d14 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.878279:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878286:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878286:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878293:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878297:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878300:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (00000000a11cf4f5) 00010000:00010000:2.0:1781281094.878302:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.878302:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.878304:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878305:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878310:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878311:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd21c89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x384:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.878318:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:0.0:1781281094.878320:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.878322:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.878323:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.878324:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.878325:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.878327:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21c74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.878336:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a3fd5a1 reply state 000000001a6702b4 transno 4294975614 ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.879574:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12456:x1867808064765888:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 3425us (3842us total) trans 4294975614 rc 0/0 00000100:00100000:0.0:1781281094.879589:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16352 00000100:00100000:0.0:1781281094.887024:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.887155:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.887254:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766080 00000100:00100000:3.0:1781281094.887306:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4759 00000100:00100000:3.0:1781281094.887314:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000165a8daf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12559:x1867808064766080:12345-192.168.202.40@tcp:37:ll_sa_12455.0 00010000:00010000:3.0:1781281094.889127:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.889137:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x220bffe4 (0000000079f1dc38) 00010000:00010000:3.0:1781281094.889140:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.889143:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.889149:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (00000000a11cf4f5) 00010000:00010000:3.0:1781281094.889150:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281094.893629:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.905999:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000165a8daf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12559:x1867808064766080:12345-192.168.202.40@tcp:37:ll_sa_12455.0 Request processed in 18677us (18836us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281094.906015:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4759 00000100:00100000:0.0:1781281094.911980:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.912137:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766336 00000100:00100000:2.0:1781281094.912200:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16354 00000100:00100000:2.0:1781281094.912206:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12456:x1867808064766336:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.912257:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.912281:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed0d8d1e/0xce40b48e7cd1d00e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08fe7 expref: 501 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912303:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca2353a0/0xce40b48e7cd1cff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08fe0 expref: 500 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912313:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd1d01c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08ff5 expref: 499 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912326:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd1abb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08368 expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912334:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (000000000eec574b) 00010000:00010000:2.0:1781281094.912342:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.912367:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912379:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912386:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912398:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912403:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912409:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912528:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x37c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912536:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.912586:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.913141:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].444, 64 off36736 00000040:00080000:2.0:1781281094.913211:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5037, 184 off884920 00010000:00010000:2.0:1781281094.913276:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913286:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913295:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913302:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913308:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913314:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913341:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.913359:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c3ad3208 reply state 0000000036299557 transno 4294975616 ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913400:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913407:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913413:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913419:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ad51d6c already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.913422:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913429:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913439:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:2.0:1781281094.913441:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.913445:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.913450:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21c97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.913457:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c3ad3208 reply state 0000000036299557 transno 4294975616 ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.913678:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12456:x1867808064766336:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1469us (1705us total) trans 4294975616 rc 0/0 00000100:00100000:2.0:1781281094.913686:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16354 00010000:00010000:0.0:1781281094.914193:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281094.914199:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.914207:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfec5cfe already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281094.914209:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.914215:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.914225:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (00000000eb14708e) 00010000:00010000:0.0:1781281094.914227:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281094.914229:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 1/0,0 mode: --/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.914234:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.914243:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.914245:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.914247:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281094.919020:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.919043:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x17610ee3 (00000000044d4d6d) 00010000:00010000:0.0:1781281094.919046:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.919052:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.919059:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (00000000eb14708e) 00010000:00010000:0.0:1781281094.919061:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.923462:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281094.923578:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766464 00000100:00100000:3.0:1781281094.923635:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4761 00000100:00100000:3.0:1781281094.923642:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12456:x1867808064766464:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.923899:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12456:x1867808064766464:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 256us (444us total) trans 4294975617 rc 0/0 00000100:00100000:3.0:1781281094.923907:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4761 00000100:00100000:0.0:1781281094.935996:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.936036:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.936399:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766656 00000100:00100000:2.0:1781281094.936437:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16355 00000100:00100000:2.0:1781281094.936442:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018fe6ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12456:x1867808064766656:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:3.0:1781281094.936457:0:6157:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.936465:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936485:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281094.936487:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.936496:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936511:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd1a6e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081b6 expref: 499 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.936513:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936527:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000098cbdbbf/0xce40b48e7cd03a54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00ba4 expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936540:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd03a93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00bb9 expref: 497 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936586:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc518572/0xce40b48e7ccffba8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3a9 expref: 496 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936593:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f5:0x0].0x0 (000000001d91642c) 00010000:00010000:2.0:1781281094.936600:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.936625:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936635:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936646:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936657:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936663:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936669:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936759:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936767:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.936774:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.938336:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].436, 64 off36096 00000040:00080000:2.0:1781281094.938360:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5038, 184 off885104 00010000:00010000:2.0:1781281094.938434:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938449:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938459:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938467:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938473:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938479:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938780:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.938802:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000018fe6ec6 reply state 00000000c7079cf5 transno 4294975618 ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938851:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938858:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938864:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938870:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ad51d6c already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.938873:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938880:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938896:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:2.0:1781281094.938899:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.938902:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.938908:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21cba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.938917:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000018fe6ec6 reply state 00000000c7079cf5 transno 4294975618 ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.939056:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018fe6ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12456:x1867808064766656:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2611us (3019us total) trans 4294975618 rc 0/0 00000100:00100000:2.0:1781281094.939065:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16355 00010000:00010000:3.0:1781281094.944900:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.944923:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.944935:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281094.945320:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].437, 64 off36160 00000040:00080000:3.0:1781281094.945341:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5039, 176 off885280 00010000:00010000:3.0:1781281094.945400:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.945411:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946774:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946783:0:6157:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946790:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946795:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946819:0:6157:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281094.946841:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c15430a reply state 0000000091c9a2a5 transno 4294975619 ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946857:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281094.946863:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946871:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000099ffc0e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281094.946874:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946881:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946894:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22f:0x0].0x0 (000000000064636d) 00010000:00010000:2.0:1781281094.946897:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.946899:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946901:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946905:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946907:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd21cdd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635863488 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946911:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946916:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b47771b already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281094.946918:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.946920:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.946921:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281094.946922:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.946928:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946936:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:3.0:1781281094.946938:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.946941:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.946946:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd21c90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281094.946954:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c15430a reply state 0000000091c9a2a5 transno 4294975619 ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.947046:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c15430a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12455:x1867808064766016:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 58448us (60027us total) trans 4294975619 rc 0/0 00000100:00100000:3.0:1781281094.947055:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16353 00010000:00010000:3.0:1781281094.953266:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.953289:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x30480a6c (00000000e5688875) 00010000:00010000:3.0:1781281094.953291:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.953297:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.953301:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f5:0x0].0x0 (0000000048065dac) 00010000:00010000:3.0:1781281094.953303:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.965518:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281094.965585:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.965587:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1781281094.965603:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x14be06ab (000000001ba3c805) 00010000:00010000:2.0:1781281094.965606:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.965610:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.965617:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22f:0x0].0x0 (000000000064636d) 00010000:00010000:2.0:1781281094.965619:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281094.965794:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766784 00000100:00100000:3.0:1781281094.965841:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064766912 00000100:00100000:3.0:1781281094.965869:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4762 00000100:00100000:3.0:1781281094.965874:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12455:x1867808064766784:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.966083:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12455:x1867808064766784:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 207us (581us total) trans 4294975620 rc 0/0 00000100:00100000:3.0:1781281094.966091:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4762 00000100:00100000:3.0:1781281094.966108:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4763 00000100:00100000:3.0:1781281094.966112:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12456:x1867808064766912:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281094.966188:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12456:x1867808064766912:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 75us (601us total) trans 4294975621 rc 0/0 00000100:00100000:3.0:1781281094.966195:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4763 00000100:00100000:0.0:1781281094.969986:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281094.970032:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.970147:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064767040 00000100:00100000:2.0:1781281094.970212:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064767168 00000100:00100000:2.0:1781281094.970242:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16356 00000100:00100000:2.0:1781281094.970250:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007879add7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12456:x1867808064767040:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.970305:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.970332:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd1a1df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08020 expref: 501 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970355:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c462259f/0xce40b48e7cd03920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00b49 expref: 500 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970370:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a834d5ee/0xce40b48e7cd0395f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00b57 expref: 499 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970380:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7ccffaac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff34e expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970390:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f3:0x0].0x0 (00000000a1fb96a4) 00010000:00010000:2.0:1781281094.970398:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.970429:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970443:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970453:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970468:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970475:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970481:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281094.970529:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16357 00000100:00100000:0.0:1781281094.970535:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12455:x1867808064767168:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:0.0:1781281094.970601:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281094.970613:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd17500 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x231:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c073a1 expref: 497 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970631:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970643:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.970649:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281094.970999:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].438, 64 off36224 00000040:00080000:2.0:1781281094.971017:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5040, 184 off885464 00010000:00010000:2.0:1781281094.971070:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971079:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971085:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971091:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971096:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971102:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971125:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281094.971139:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007879add7 reply state 00000000d8ede341 transno 4294975622 ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971184:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971189:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971194:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971199:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac28a732 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281094.971202:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971207:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971215:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:2.0:1781281094.971217:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281094.971219:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.971224:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21ce4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281094.971231:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007879add7 reply state 00000000d8ede341 transno 4294975622 ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281094.971301:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007879add7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12456:x1867808064767040:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1050us (1322us total) trans 4294975622 rc 0/0 00000100:00100000:2.0:1781281094.971312:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16356 00010000:00010000:0.0:1781281094.971439:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c778e779/0xce40b48e7cd067cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x231:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01a6f expref: 497 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971451:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000c5198ed/0xce40b48e7cd06836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x231:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01a99 expref: 496 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971462:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd0143d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x231:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd5e expref: 495 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971470:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x231:0x0].0x0 (000000001b8df50f) 00010000:00010000:0.0:1781281094.971476:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281094.971493:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971514:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971521:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971535:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971566:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.971573:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.972854:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.972874:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.972889:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281094.973255:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].439, 64 off36288 00000040:00080000:0.0:1781281094.973274:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5041, 184 off885648 00010000:00010000:0.0:1781281094.973333:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973344:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973351:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973357:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973362:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973367:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973394:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:0.0:1781281094.973412:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d734d079 reply state 00000000ec6f4714 transno 4294975623 ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973471:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973477:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973482:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973487:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281094.973491:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973498:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973518:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:0.0:1781281094.973521:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.973525:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.973530:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281094.973566:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d734d079 reply state 00000000ec6f4714 transno 4294975623 ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973730:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281094.973736:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973743:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f2cec12f already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.973746:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973752:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973761:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f3:0x0].0x0 (0000000003cde912) 00010000:00010000:3.0:1781281094.973763:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.973765:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973774:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21cf9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973784:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281094.973786:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973792:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc851d66 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281094.973794:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973799:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973806:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x231:0x0].0x0 (00000000b3d14d67) 00010000:00010000:3.0:1781281094.973808:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281094.973809:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973814:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd21d15 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.973822:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.973823:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281094.973824:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281094.975292:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12455:x1867808064767168:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 4750us (5254us total) trans 4294975623 rc 0/0 00000100:00100000:0.0:1781281094.975304:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16357 00000100:00100000:0.0:1781281094.980128:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064767296 00000100:00100000:0.0:1781281094.980186:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4764 00000100:00100000:0.0:1781281094.980192:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12456:x1867808064767296:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281094.980410:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12456:x1867808064767296:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 217us (411us total) trans 4294975624 rc 0/0 00000100:00100000:0.0:1781281094.980430:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4764 00010000:00010000:0.0:1781281094.981030:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.981047:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x77103a66 (000000009ecb2db0) 00010000:00010000:0.0:1781281094.981050:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281094.981055:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281094.981061:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x231:0x0].0x0 (00000000b3d14d67) 00010000:00010000:0.0:1781281094.981063:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.981458:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281094.986161:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.986183:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x4e78d319 (00000000f5d23c62) 00010000:00010000:3.0:1781281094.986186:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281094.986191:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281094.986198:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f3:0x0].0x0 (0000000003cde912) 00010000:00010000:3.0:1781281094.986200:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281094.993969:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281094.994156:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064767552 00000100:00100000:2.0:1781281094.994206:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16358 00000100:00100000:2.0:1781281094.994212:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009c0a31c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12456:x1867808064767552:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281094.994269:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281094.994296:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c22e26f/0xce40b48e7cd03824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ef:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00af5 expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994316:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019fa95ea/0xce40b48e7ccff8e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ef:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2b4 expref: 497 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994327:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e208e2a/0xce40b48e7cd03847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ef:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00b03 expref: 496 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994339:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007d139342/0xce40b48e7ccff8bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ef:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2a6 expref: 495 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994349:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ef:0x0].0x0 (000000004f144573) 00010000:00010000:2.0:1781281094.994358:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281094.994388:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994403:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994427:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994456:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994462:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994468:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994629:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994638:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281094.994644:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281094.995611:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000040:00080000:2.0:1781281094.999324:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].440, 64 off36352 00000040:00080000:2.0:1781281094.999347:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5042, 184 off885832 00010000:00010000:2.0:1781281095.000578:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.000601:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.000614:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.000772:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.000780:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.000850:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001438:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281095.001463:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000009c0a31c reply state 0000000063eebbd0 transno 4294975626 ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001532:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001571:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001579:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001585:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eb7c1166 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.001589:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001596:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001613:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:2.0:1781281095.001626:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.001629:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.001635:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281095.001646:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000009c0a31c reply state 0000000063eebbd0 transno 4294975626 ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281095.001928:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009c0a31c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12456:x1867808064767552:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 7712us (7965us total) trans 4294975626 rc 0/0 00000100:00100000:2.0:1781281095.001939:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16358 00010000:00010000:0.0:1781281095.002276:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002290:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002299:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002313:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002320:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002326:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002425:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002434:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.002441:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281095.003026:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].445, 64 off36800 00000040:00080000:0.0:1781281095.003047:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5043, 184 off886016 00010000:00010000:0.0:1781281095.003106:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x233:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.003117:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.003124:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.003131:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.003136:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.003145:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.008564:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281095.008577:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.008591:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f2cec12f already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281095.008595:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.008603:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.008629:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ef:0x0].0x0 (000000002ea904e8) 00010000:00010000:3.0:1781281095.008633:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281095.008638:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.008644:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.008751:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281095.008756:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.008763:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd082e3d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281095.008765:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.008772:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.008780:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x233:0x0].0x0 (000000007ef33e22) 00010000:00010000:2.0:1781281095.008782:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281095.008785:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 3/0,0 mode: --/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.008793:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281095.008794:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281095.008796:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281095.008888:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281095.010806:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.010820:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xe2501d74 (0000000007ba61ef) 00010000:00010000:3.0:1781281095.010823:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.010827:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.010833:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ef:0x0].0x0 (000000002ea904e8) 00010000:00010000:3.0:1781281095.010835:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281095.012568:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1781281095.012580:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21d4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x233:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.012822:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1781281095.012849:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d5657e3 reply state 000000008fd9fa4e transno 4294975627 ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012910:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012917:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012923:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012928:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.012932:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012939:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012953:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:0.0:1781281095.012956:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.012960:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.012965:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x22d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281095.012974:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d5657e3 reply state 000000008fd9fa4e transno 4294975627 ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281095.013062:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d5657e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+491:12455:x1867808064767680:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 17037us (17451us total) trans 4294975627 rc 0/0 00000100:00100000:0.0:1781281095.013070:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16359 00000100:00100000:2.0:1781281095.019014:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.019114:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064767936 00000100:00100000:0.0:1781281095.019163:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4766 00000100:00100000:0.0:1781281095.019168:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bef838 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+491:12456:x1867808064767936:12345-192.168.202.40@tcp:35:dbench.0 00000004:00080000:0.0:1781281095.020017:0:6160:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x3af:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1781281095.020077:0:6160:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].441, 64 off36416 00000040:00080000:0.0:1781281095.020095:0:6160:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5044, 168 off886184 00000001:00080000:0.0:1781281095.020100:0:6160:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 4294975628 00010000:00010000:0.0:1781281095.020134:0:6160:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.020150:0:6160:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.020162:0:6160:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.020170:0:6160:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.020178:0:6160:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.020183:0:6160:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd21d69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3af:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.020802:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.020814:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0xc4fc354d (000000001b8df50f) 00010000:00010000:3.0:1781281095.020816:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.020820:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.020825:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x233:0x0].0x0 (000000007ef33e22) 00010000:00010000:3.0:1781281095.020827:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281095.021815:0:6160:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281095.021980:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bef838 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+492:12456:x1867808064767936:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 2808us (2972us total) trans 4294975628 rc 0/0 00000100:00100000:0.0:1781281095.021992:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4766 00000100:00100000:2.0:1781281095.023604:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.024108:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281095.024805:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281095.024808:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281095.024810:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281095.026570:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281095.026575:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd21d70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.026583:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f3c60d09 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281095.026586:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd21d70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.026594:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd21d70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.026607:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (0000000062e104fb) 00010000:00010000:2.0:1781281095.026610:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281095.026614:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd21d70 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.026619:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd21d70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.026643:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281095.026645:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281095.026646:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281095.033585:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064768000 00000100:00100000:2.0:1781281095.033785:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16361 00000100:00100000:2.0:1781281095.033794:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+493:12455:x1867808064768000:12345-192.168.202.40@tcp:101:dbench.0 00010000:00010000:2.0:1781281095.033816:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.033845:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a748 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033910:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033924:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033936:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033950:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033957:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.033963:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034081:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034089:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034096:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281095.034126:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e2:0x0]: returning size 11264 00000004:00200000:2.0:1781281095.034130:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281095.034154:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034165:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034171:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034178:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034184:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f2cec12f already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.034187:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034194:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034206:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (00000000a1fb96a4) 00010000:00010000:2.0:1781281095.034208:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.034213:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034218:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f2cec12f/0xce40b48e7cd21d7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034233:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034238:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034243:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034249:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac28a732 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.034250:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034256:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034262:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (000000000eec574b) 00010000:00010000:2.0:1781281095.034264:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.034265:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034270:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac28a732/0xce40b48e7cd21d85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034298:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb7c1166/0xce40b48e7cd21d77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a748 expref: 495 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034312:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a748 expref: 494 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.034323:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000443c972a) 00010000:00010000:2.0:1781281095.034325:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281095.034327:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.034390:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+494:12455:x1867808064768000:12345-192.168.202.40@tcp:101:dbench.0 Request processed in 596us (10789us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.034398:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16361 00000100:00100000:2.0:1781281095.045798:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.049146:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281095.050853:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281095.050859:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd21da8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.050867:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007284a589 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281095.050869:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd21da8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.050875:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd21da8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.050884:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1eb:0x0].0x0 (0000000086fad4e2) 00010000:00010000:3.0:1781281095.050887:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281095.050889:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd21da8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.050894:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd21da8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.050905:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.050906:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.050907:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.051882:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.051896:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xd8045a37 (000000004f144573) 00010000:00010000:3.0:1781281095.051898:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.051901:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.051906:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1eb:0x0].0x0 (0000000086fad4e2) 00010000:00010000:3.0:1781281095.051908:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281095.055974:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.056091:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064768512 00000100:00100000:2.0:1781281095.056146:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4769 00000100:00100000:2.0:1781281095.056153:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006976af01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+493:12455:x1867808064768512:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281095.056383:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006976af01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+494:12455:x1867808064768512:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 229us (417us total) trans 4294975632 rc 0/0 00000100:00100000:2.0:1781281095.056392:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4769 00000100:00100000:0.0:1781281095.058740:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.059607:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064768640 00000100:00100000:2.0:1781281095.059690:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16363 00000100:00100000:2.0:1781281095.059696:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff893dee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+494:12455:x1867808064768640:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281095.059758:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281095.059788:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b273b69e/0xce40b48e7cd032f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00943 expref: 494 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059816:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c1513102/0xce40b48e7ccff6a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1c6 expref: 493 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059828:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000944b7559/0xce40b48e7cd03369 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0096d expref: 492 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059839:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f1941917/0xce40b48e7ccff692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e9:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1b8 expref: 491 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059848:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e9:0x0].0x0 (000000005c561e02) 00010000:00010000:2.0:1781281095.059859:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281095.059891:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059906:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059915:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059928:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059933:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.059939:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060035:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060042:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060053:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281095.060435:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].444, 64 off36608 00000040:00080000:2.0:1781281095.060461:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5047, 184 off886720 00010000:00010000:2.0:1781281095.060528:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060537:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060578:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060586:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060591:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060597:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060613:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1781281095.060630:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ff893dee reply state 000000009ab66ab5 transno 4294975633 ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060676:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060685:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060690:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060694:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003111fe9e already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.060697:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060703:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060711:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:2.0:1781281095.060713:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.060716:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.060721:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21daf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281095.060729:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ff893dee reply state 000000009ab66ab5 transno 4294975633 ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281095.060809:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff893dee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+492:12455:x1867808064768640:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 1112us (2076us total) trans 4294975633 rc 0/0 00000100:00100000:2.0:1781281095.060818:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16363 00010000:00010000:0.0:1781281095.062759:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281095.062769:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.062782:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ed31c0f9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281095.062785:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.062794:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.062809:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e9:0x0].0x0 (00000000d8c8139f) 00010000:00010000:0.0:1781281095.062811:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1781281095.062815:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.062820:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd21dc4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.062838:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281095.062839:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281095.062840:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281095.066113:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.066137:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x8e4542d7 (000000000eec574b) 00010000:00010000:0.0:1781281095.066140:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.066144:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.066151:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e9:0x0].0x0 (00000000d8c8139f) 00010000:00010000:0.0:1781281095.066153:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281095.072680:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.072844:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064768768 00000100:00100000:2.0:1781281095.072900:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16364 00000100:00100000:2.0:1781281095.072906:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b2bd361 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+492:12455:x1867808064768768:12345-192.168.202.40@tcp:36:dbench.0 00010000:00010000:2.0:1781281095.072998:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281095.073024:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21d8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a748 expref: 492 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073042:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000443c972a) 00010000:00010000:2.0:1781281095.073050:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281095.073084:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073098:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073109:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073121:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073128:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073134:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073253:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073261:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073267:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073339:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073348:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073355:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073361:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eac9999e already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.073365:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073373:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073381:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.073384:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1781281095.073386:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073392:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21dd9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073405:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073494:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073510:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073515:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000074ed0297 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.073517:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073524:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.073531:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (00000000a1fb96a4) 00010000:00010000:2.0:1781281095.073533:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.073535:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074455:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dcb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074482:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074487:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074492:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074513:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000045ac1e68 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.074517:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074522:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074533:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (00000000cd8f5088) 00010000:00010000:2.0:1781281095.074536:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.074538:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.074577:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21dd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281095.074974:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b2bd361 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+491:12455:x1867808064768768:12345-192.168.202.40@tcp:36:dbench.0 Request processed in 2063us (2299us total) trans 0 rc -39/-39 00000100:00100000:2.0:1781281095.074985:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16364 00000100:00100000:3.0:1781281095.090033:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.090135:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064768896 00000100:00100000:0.0:1781281095.090192:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4770 00000100:00100000:0.0:1781281095.090199:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080b4c913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+491:12455:x1867808064768896:12345-192.168.202.40@tcp:35:dbench.0 00000004:00080000:0.0:1781281095.090606:0:6160:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x1fc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1781281095.090813:0:6160:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].446, 64 off36864 00000040:00080000:0.0:1781281095.090834:0:6160:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5048, 168 off886888 00010000:00010000:0.0:1781281095.090903:0:6160:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090921:0:6160:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090934:0:6160:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090943:0:6160:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090950:0:6160:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090956:0:6160:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.090984:0:6160:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281095.091112:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080b4c913 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+492:12455:x1867808064768896:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 911us (1087us total) trans 4294975634 rc 0/0 00000100:00100000:0.0:1781281095.091121:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4770 00010000:00010000:3.0:1781281095.091569:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281095.091576:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.091584:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd082e3d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281095.091588:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.091595:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.091611:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (000000007954595b) 00010000:00010000:3.0:1781281095.091614:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281095.091914:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.091922:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd21de0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436578698688 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.091938:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.091939:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.091941:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281095.095095:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.095212:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769024 00000100:00100000:2.0:1781281095.095275:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4771 00000100:00100000:2.0:1781281095.095285:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7fae140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+492:12455:x1867808064769024:12345-192.168.202.40@tcp:35:dbench.0 00000004:00080000:2.0:1781281095.095896:0:12447:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x268:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1781281095.095964:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].447, 64 off36928 00000040:00080000:2.0:1781281095.095984:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5049, 168 off887056 00010000:00010000:2.0:1781281095.096052:0:12447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x268:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096073:0:12447:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096085:0:12447:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096094:0:12447:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096100:0:12447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096106:0:12447:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.096123:0:12447:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1781281095.097190:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281095.097198:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.097208:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000045ac1e68 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281095.097211:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.097219:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.097234:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000c3728c87) 00010000:00010000:3.0:1781281095.097237:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281095.097241:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.097247:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000045ac1e68/0xce40b48e7cd21de7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.097263:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.097264:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.097266:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281095.097857:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7fae140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+493:12455:x1867808064769024:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 2567us (2768us total) trans 4294975635 rc 0/0 00000100:00100000:2.0:1781281095.097868:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4771 00000100:00100000:2.0:1781281095.110736:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769152 00000100:00100000:2.0:1781281095.110783:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4772 00000100:00100000:2.0:1781281095.110790:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+493:12455:x1867808064769152:12345-192.168.202.40@tcp:35:dbench.0 00000004:00080000:2.0:1781281095.111143:0:12447:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x267:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1781281095.111297:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].445, 64 off36672 00000040:00080000:2.0:1781281095.111315:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5050, 168 off887224 00010000:00010000:2.0:1781281095.111382:0:12447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x267:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111408:0:12447:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111430:0:12447:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111440:0:12447:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111446:0:12447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111452:0:12447:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000074ed0297/0xce40b48e7cd21dee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.111481:0:12447:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281095.112409:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+494:12455:x1867808064769152:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 1614us (1816us total) trans 4294975636 rc 0/0 00000100:00100000:2.0:1781281095.112428:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4772 00000100:00100000:3.0:1781281095.118433:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.118656:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769280 00000100:00100000:2.0:1781281095.118707:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4773 00000100:00100000:2.0:1781281095.118714:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+494:12455:x1867808064769280:12345-192.168.202.40@tcp:35:dbench.0 00000004:00080000:2.0:1781281095.119054:0:12447:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x265:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1781281095.119120:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].446, 64 off36736 00000040:00080000:2.0:1781281095.119139:0:12447:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5051, 168 off887392 00010000:00010000:2.0:1781281095.119206:0:12447:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x265:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119227:0:12447:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119240:0:12447:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119248:0:12447:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119253:0:12447:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119259:0:12447:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.119274:0:12447:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281095.119392:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+495:12455:x1867808064769280:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 677us (979us total) trans 4294975637 rc 0/0 00000100:00100000:2.0:1781281095.119400:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4773 00010000:00010000:3.0:1781281095.119817:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281095.119824:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.119834:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eac9999e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281095.119837:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.119845:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.119860:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x265:0x0].0x0 (00000000d4f02738) 00010000:00010000:3.0:1781281095.119863:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281095.119868:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.119874:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eac9999e/0xce40b48e7cd21df5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639432244278976 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.119891:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.119893:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281095.119894:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281095.138897:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769408 00000100:00100000:2.0:1781281095.138973:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4774 00000100:00100000:2.0:1781281095.138979:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+495:12454:x1867808064769408:12345-192.168.202.40@tcp:35:dbench.0 00000001:00080000:2.0:1781281095.139347:0:6160:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 4294975638 00000100:00100000:2.0:1781281095.139471:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12454:x1867808064769408:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 491us (2892us total) trans 4294975638 rc 0/0 00000100:00100000:2.0:1781281095.139481:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4774 00000100:00100000:2.0:1781281095.141887:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769536 00000100:00100000:2.0:1781281095.141942:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4775 00000100:00100000:2.0:1781281095.141948:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12454:x1867808064769536:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281095.142154:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12454:x1867808064769536:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 204us (446us total) trans 4294975639 rc 0/0 00000100:00100000:2.0:1781281095.142161:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4775 00000100:00100000:3.0:1781281095.150312:0:6160:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769664 00000100:00100000:3.0:1781281095.150394:0:6160:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4776 00000100:00100000:3.0:1781281095.150401:0:6160:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12454:x1867808064769664:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:3.0:1781281095.150714:0:6160:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12454:x1867808064769664:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 312us (6537us total) trans 4294975640 rc 0/0 00000100:00100000:3.0:1781281095.150723:0:6160:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4776 00000100:00100000:2.0:1781281095.152918:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769792 00000100:00100000:2.0:1781281095.152956:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4777 00000100:00100000:2.0:1781281095.152961:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a584c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12454:x1867808064769792:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:2.0:1781281095.153149:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a584c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12454:x1867808064769792:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 187us (399us total) trans 4294975641 rc 0/0 00000100:00100000:2.0:1781281095.153157:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4777 00000100:00100000:0.0:1781281095.154835:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769920 00000100:00100000:0.0:1781281095.154886:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4778 00000100:00100000:0.0:1781281095.154892:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12454:x1867808064769920:12345-192.168.202.40@tcp:35:dbench.0 00000100:00100000:0.0:1781281095.155101:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12454:x1867808064769920:12345-192.168.202.40@tcp:35:dbench.0 Request processed in 209us (431us total) trans 4294975642 rc 0/0 00000100:00100000:0.0:1781281095.155108:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4778 00000100:00100000:2.0:1781281095.165329:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064769984 00000100:00100000:2.0:1781281095.165374:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16365 00000100:00100000:2.0:1781281095.165379:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12561:x1867808064769984:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1781281095.165401:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.165427:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a74f expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165482:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165496:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165517:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281095.165606:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1db:0x0]: returning size 11264 00000004:00200000:2.0:1781281095.165610:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281095.165642:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165665:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a74f expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165679:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a74f expref: 501 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.165686:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.165689:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281095.165692:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003111fe9e, rc 0) 00000100:00100000:2.0:1781281095.165738:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062e0946d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12561:x1867808064769984:12345-192.168.202.40@tcp:101:bash.0 Request processed in 358us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.165744:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16365 00000100:00100000:2.0:1781281095.167895:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.174801:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bef838 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12561:x1867808064770048:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6770us (6904us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.174819:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16366 00000100:00100000:0.0:1781281095.189336:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.189536:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770112 00000100:00100000:0.0:1781281095.189716:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16367 00000100:00100000:0.0:1781281095.189724:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f1278db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770112:12345-192.168.202.40@tcp:101:date.0 00010000:00010000:0.0:1781281095.189747:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.189768:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a75d expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189827:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189842:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189854:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189868:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189874:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189880:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189946:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189953:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189964:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189970:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.189973:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189980:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.189991:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.189994:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.189998:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190004:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190034:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190039:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190045:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190050:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.190052:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190058:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190064:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xeddcfc6c (00000000e61cd319) 00010000:00010000:0.0:1781281095.190067:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.190068:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190074:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190107:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e1f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a75d expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190115:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a75d expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.190124:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.190186:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f1278db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770112:12345-192.168.202.40@tcp:101:date.0 Request processed in 462us (860us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.190194:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16367 00000100:00100000:2.0:1781281095.201135:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770176 00000100:00100000:2.0:1781281095.201199:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16368 00000100:00100000:2.0:1781281095.201206:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770176:12345-192.168.202.40@tcp:101:date.0 00010000:00010000:2.0:1781281095.201228:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.201251:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a764 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201314:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201330:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201341:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201356:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201363:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201369:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201538:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201583:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201589:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201594:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.201598:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201604:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201691:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.201695:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.201699:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201705:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201718:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201723:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201729:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201734:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.201736:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201742:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201749:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x3491cd4c (0000000010bae9cd) 00010000:00010000:2.0:1781281095.201751:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.201753:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201763:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201798:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e34 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a764 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201806:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a764 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.201814:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.201873:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770176:12345-192.168.202.40@tcp:101:date.0 Request processed in 666us (908us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.201881:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16368 00000100:00100000:0.0:1781281095.206120:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770240 00000100:00100000:0.0:1781281095.206178:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16369 00000100:00100000:0.0:1781281095.206185:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770240:12345-192.168.202.40@tcp:101:date.0 00010000:00010000:0.0:1781281095.206207:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.206230:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a76b expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206297:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206312:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206323:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206337:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206344:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206350:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206495:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206514:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206520:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206525:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.206528:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206536:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206590:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.206593:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.206597:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.206604:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207515:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207526:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207532:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207537:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.207563:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207570:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207581:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x3735a305 (00000000e61cd319) 00010000:00010000:0.0:1781281095.207583:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.207586:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207591:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207859:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e49 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a76b expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207867:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a76b expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.207878:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.207952:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770240:12345-192.168.202.40@tcp:101:date.0 Request processed in 1766us (2919us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.207961:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16369 00000100:00100000:0.0:1781281095.226873:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770368 00000100:00100000:0.0:1781281095.226951:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16370 00000100:00100000:0.0:1781281095.226957:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770368:12345-192.168.202.40@tcp:101:date.0 00010000:00010000:0.0:1781281095.226977:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.226998:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a772 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227064:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227078:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227093:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227107:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227113:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227118:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227194:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227200:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227205:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227210:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.227213:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227220:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227230:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.227234:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.227238:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227244:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227263:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227268:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227273:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227278:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.227281:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227286:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227293:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x820cea43 (00000000e61cd319) 00010000:00010000:0.0:1781281095.227295:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.227297:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227302:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227345:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e5e lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a772 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227353:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a772 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.227362:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.227447:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12562:x1867808064770368:12345-192.168.202.40@tcp:101:date.0 Request processed in 490us (3804us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.227455:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16370 00000100:00100000:2.0:1781281095.238771:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770432 00000100:00100000:2.0:1781281095.238850:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16371 00000100:00100000:2.0:1781281095.238858:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12429:x1867808064770432:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1781281095.238882:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.238907:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a779 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.238974:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.238988:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239000:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239013:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239020:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239025:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239101:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239109:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239115:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239121:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.239124:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239130:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239141:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.239143:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.239147:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239158:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21e7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239171:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239177:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239183:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239188:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.239190:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239195:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239201:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x4e1a61e4 (0000000010bae9cd) 00010000:00010000:2.0:1781281095.239204:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.239205:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239211:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21e81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239239:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e73 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a779 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239252:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a779 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.239260:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.239328:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12429:x1867808064770432:12345-192.168.202.40@tcp:101:bash.0 Request processed in 470us (1900us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.239335:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16371 00000100:00100000:0.0:1781281095.272587:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770560 00000100:00100000:0.0:1781281095.272648:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16372 00000100:00100000:0.0:1781281095.272655:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770560:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.272675:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.272696:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a780 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272767:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272781:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272793:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272806:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272813:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272818:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272891:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272898:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272904:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272910:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.272913:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272920:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272931:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.272933:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.272937:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272942:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21e8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272962:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272968:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272973:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272978:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.272980:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272984:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272990:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x5eacde (00000000e61cd319) 00010000:00010000:0.0:1781281095.272992:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.272994:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.272999:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.273032:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e88 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a780 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.273039:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a780 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.273051:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.273100:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770560:12345-192.168.202.40@tcp:101:ps.0 Request processed in 445us (1021us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.273107:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16372 00000100:00100000:2.0:1781281095.279979:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770688 00000100:00100000:2.0:1781281095.280043:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16373 00000100:00100000:2.0:1781281095.280050:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770688:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:2.0:1781281095.280076:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.280100:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a787 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280167:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280179:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280203:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280218:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280224:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280231:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280311:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280319:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280325:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280331:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.280334:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280340:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280351:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.280360:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.280368:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280373:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ea4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280390:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280400:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280406:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280411:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.280413:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280418:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280426:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x55f752d8 (0000000010bae9cd) 00010000:00010000:2.0:1781281095.280428:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.280430:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280435:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280468:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e9d lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a787 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280476:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21e9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a787 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.280484:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.280694:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770688:12345-192.168.202.40@tcp:101:ps.0 Request processed in 642us (938us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.280703:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16373 00000100:00100000:0.0:1781281095.294041:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770816 00000100:00100000:0.0:1781281095.294096:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16374 00000100:00100000:0.0:1781281095.294103:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770816:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.294125:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.294146:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21eb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a78e expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294228:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294244:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294255:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294268:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294275:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294281:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294365:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294372:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294378:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294384:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.294388:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294395:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294407:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.294410:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.294414:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294419:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294435:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294441:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294451:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294456:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.294457:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294463:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294470:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xaf3dc4c9 (00000000e61cd319) 00010000:00010000:0.0:1781281095.294472:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.294473:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294478:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294521:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21eb2 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a78e expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294529:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21eb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a78e expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.294539:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.294644:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770816:12345-192.168.202.40@tcp:101:ps.0 Request processed in 541us (710us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.294652:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16374 00000100:00100000:2.0:1781281095.299596:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064770944 00000100:00100000:2.0:1781281095.299650:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16375 00000100:00100000:2.0:1781281095.299657:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770944:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:2.0:1781281095.299679:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.299700:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21ec7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a795 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299775:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299803:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299816:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299830:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299837:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299844:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299917:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299924:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299930:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299937:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.299940:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299946:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299957:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.299960:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.299963:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299969:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21ece lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299981:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299987:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.299992:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300001:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.300003:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300008:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300015:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x46114526 (0000000010bae9cd) 00010000:00010000:2.0:1781281095.300017:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.300019:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300024:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21ed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300054:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21ec7 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a795 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300062:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21ec7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a795 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.300069:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.300122:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064770944:12345-192.168.202.40@tcp:101:ps.0 Request processed in 465us (680us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.300128:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16375 00000100:00100000:0.0:1781281095.314275:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771072 00000100:00100000:0.0:1781281095.314340:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16376 00000100:00100000:0.0:1781281095.314347:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771072:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.314369:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.314388:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21edc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a79c expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314455:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314469:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314481:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314509:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314516:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314523:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314634:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314641:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314653:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314659:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.314662:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314668:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314679:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.314683:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.314687:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314692:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21ee3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314711:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314716:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314721:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314725:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.314727:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314732:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314737:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x907a850 (00000000e61cd319) 00010000:00010000:0.0:1781281095.314739:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.314741:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314745:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21eea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314775:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21edc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a79c expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.314782:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21edc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a79c expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.315405:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.315468:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771072:12345-192.168.202.40@tcp:101:ps.0 Request processed in 1120us (2233us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.315476:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16376 00000100:00100000:0.0:1781281095.325197:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771200 00000100:00100000:0.0:1781281095.325275:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16377 00000100:00100000:0.0:1781281095.325281:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771200:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.325304:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.325324:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21ef1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7a3 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325400:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325415:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325426:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325439:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325447:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325452:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325564:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325572:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325578:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325593:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.325596:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325603:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325616:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.325619:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.325622:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325627:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21ef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325640:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325645:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325650:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325655:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.325657:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325662:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325668:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x85a1b653 (00000000e61cd319) 00010000:00010000:0.0:1781281095.325670:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.325672:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325677:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325709:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21ef1 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7a3 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325716:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21ef1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7a3 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.325724:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.325787:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771200:12345-192.168.202.40@tcp:101:ps.0 Request processed in 504us (4159us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.325794:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16377 00000100:00100000:0.0:1781281095.329758:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771328 00000100:00100000:0.0:1781281095.329826:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16378 00000100:00100000:0.0:1781281095.329833:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771328:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.329856:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.329881:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7aa expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.329976:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.329992:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330008:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330022:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330029:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330035:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330100:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330107:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330113:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330118:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000edfb6f85 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.330122:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330128:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330137:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.330140:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.330144:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330149:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330161:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330166:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330172:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330176:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceec7a8f already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.330178:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330251:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330259:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x102009d5 (000000001d91642c) 00010000:00010000:0.0:1781281095.330261:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.330263:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330268:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330306:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f06 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7aa expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330312:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7aa expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.330322:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000906608, rc 0) 00000100:00100000:0.0:1781281095.330370:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771328:12345-192.168.202.40@tcp:101:ps.0 Request processed in 537us (1117us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.330377:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16378 00000100:00100000:0.0:1781281095.336033:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771456 00000100:00100000:0.0:1781281095.336091:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16379 00000100:00100000:0.0:1781281095.336097:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771456:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.336123:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.336146:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7b1 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336229:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336246:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336258:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336271:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336278:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336284:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336365:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336372:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336378:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336383:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.336386:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336393:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336404:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.336407:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.336411:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336416:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336435:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336441:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336447:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336451:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.336453:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336458:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336464:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x42ab077a (000000000d7f90d4) 00010000:00010000:0.0:1781281095.336467:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.336468:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336473:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336527:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f1b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7b1 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336535:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7b1 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.336571:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.336745:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771456:12345-192.168.202.40@tcp:101:ps.0 Request processed in 646us (1006us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.336753:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16379 00000100:00100000:0.0:1781281095.360941:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771584 00000100:00100000:0.0:1781281095.360991:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16380 00000100:00100000:0.0:1781281095.360997:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771584:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.361016:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.361033:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7b8 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361089:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361102:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361111:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361120:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361124:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361128:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361195:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361199:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361204:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361208:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.361211:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361215:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361224:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.361226:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.361229:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361233:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21f37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361246:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361249:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361257:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361260:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.361261:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361264:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361267:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x28a377f8 (000000000d7f90d4) 00010000:00010000:0.0:1781281095.361268:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.361269:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361272:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21f3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361297:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f30 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7b8 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361301:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21f30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7b8 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.361306:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.361355:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771584:12345-192.168.202.40@tcp:101:ps.0 Request processed in 358us (537us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.361360:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16380 00000100:00100000:0.0:1781281095.365197:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771712 00000100:00100000:0.0:1781281095.365259:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16381 00000100:00100000:0.0:1781281095.365265:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771712:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.365286:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.365306:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7bf expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365375:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365388:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365400:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365415:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365421:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365427:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365517:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365524:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365535:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365575:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceec7a8f already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.365580:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365588:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365599:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.365602:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.365606:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365611:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365630:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365636:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365641:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365646:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000edfb6f85 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.365648:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365655:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365662:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x90ba0166 (000000001d91642c) 00010000:00010000:0.0:1781281095.365664:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.365665:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365671:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365711:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f45 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7bf expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365719:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7bf expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.365731:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000906608, rc 0) 00000100:00100000:0.0:1781281095.365798:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771712:12345-192.168.202.40@tcp:101:ps.0 Request processed in 531us (711us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.365805:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16381 00000100:00100000:2.0:1781281095.384403:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771840 00000100:00100000:2.0:1781281095.384462:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16382 00000100:00100000:2.0:1781281095.384468:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081ace848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771840:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:2.0:1781281095.384527:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.384597:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7c6 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384673:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384688:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384701:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384716:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384722:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384727:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384922:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384930:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384937:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384947:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.384951:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384957:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384968:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.384971:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.384975:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384980:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384992:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.384997:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385002:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385006:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.385008:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385014:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385021:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xce5b6a33 (0000000010bae9cd) 00010000:00010000:2.0:1781281095.385024:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.385025:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385030:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385068:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f5a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7c6 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385075:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7c6 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.385083:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.385139:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081ace848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771840:12345-192.168.202.40@tcp:101:ps.0 Request processed in 670us (942us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.385148:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16382 00000100:00100000:0.0:1781281095.396217:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064771968 00000100:00100000:0.0:1781281095.396279:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16383 00000100:00100000:0.0:1781281095.396285:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771968:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.396306:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.396325:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7cd expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396395:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396408:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396417:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396431:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396437:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.396443:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396600:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396609:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396615:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396621:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000edfb6f85 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.396625:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396632:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396643:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.396646:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.396651:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396656:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd21f76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396673:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396679:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396684:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396689:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceec7a8f already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.396691:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396696:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396703:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xe87eaafc (000000001d91642c) 00010000:00010000:2.0:1781281095.396705:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.396707:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396713:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd21f7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396755:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f6f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7cd expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396762:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd21f6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7cd expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.396773:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000906608, rc 0) 00000100:00100000:2.0:1781281095.396830:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064771968:12345-192.168.202.40@tcp:101:ps.0 Request processed in 543us (1434us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.396837:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16383 00000100:00100000:2.0:1781281095.406889:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772096 00000100:00100000:2.0:1781281095.406942:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16384 00000100:00100000:2.0:1781281095.406948:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ff57beb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772096:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:2.0:1781281095.406972:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.406997:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7d4 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407099:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407114:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407129:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407143:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407150:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407156:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407236:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407244:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407251:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407257:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.407261:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407267:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407278:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.407282:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.407285:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407291:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21f8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407301:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407305:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407309:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407312:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.407313:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407316:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407319:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xc9c87587 (0000000010bae9cd) 00010000:00010000:2.0:1781281095.407321:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.407322:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407324:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21f92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407353:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f84 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7d4 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407358:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7d4 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.407363:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.407416:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ff57beb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772096:12345-192.168.202.40@tcp:101:ps.0 Request processed in 467us (1020us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.407422:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16384 00000100:00100000:2.0:1781281095.413281:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772224 00000100:00100000:2.0:1781281095.413342:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16385 00000100:00100000:2.0:1781281095.413349:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f093c9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772224:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:2.0:1781281095.413370:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.413390:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7db expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413478:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413493:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413516:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413529:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413536:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.413574:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414024:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414033:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414040:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414046:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.414049:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414055:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414067:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:2.0:1781281095.414070:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.414074:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414079:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd21fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414095:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414099:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414104:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414109:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.414110:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414115:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414121:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xfb43d54d (0000000010bae9cd) 00010000:00010000:2.0:1781281095.414123:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.414125:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414130:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd21fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414162:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f99 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7db expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414170:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd21f99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7db expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.414183:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046b443e6, rc 0) 00000100:00100000:2.0:1781281095.414291:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f093c9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772224:12345-192.168.202.40@tcp:101:ps.0 Request processed in 941us (1128us total) trans 0 rc 301/301 00000100:00100000:2.0:1781281095.414299:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16385 00000100:00100000:2.0:1781281095.422138:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.422305:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772352 00000100:00100000:0.0:1781281095.422379:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16386 00000100:00100000:0.0:1781281095.422386:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183cb8ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772352:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.422413:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.422441:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7e2 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422539:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422596:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422607:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422921:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422930:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.422937:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423022:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423030:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423037:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423043:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.423047:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423054:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423066:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.423069:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.423073:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423079:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423097:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423103:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423108:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423114:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.423116:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423121:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423128:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x2ca39d83 (000000000d7f90d4) 00010000:00010000:0.0:1781281095.423130:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.423132:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423142:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423312:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fae lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7e2 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423320:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7e2 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.423330:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.423431:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183cb8ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772352:12345-192.168.202.40@tcp:101:ps.0 Request processed in 1044us (1301us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.423440:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16386 00000100:00100000:2.0:1781281095.433278:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.433365:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772480 00000100:00100000:0.0:1781281095.433421:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16387 00000100:00100000:0.0:1781281095.433427:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000960c9f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772480:12345-192.168.202.40@tcp:101:ps.0 00010000:00010000:0.0:1781281095.433447:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.433469:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7e9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433567:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433582:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433595:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433609:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433626:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433632:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433702:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433709:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433714:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433720:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.433723:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433729:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433742:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:0.0:1781281095.433744:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.433748:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433758:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd21fca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433772:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433778:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433783:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433788:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.433790:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433795:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433801:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xb8395982 (000000000d7f90d4) 00010000:00010000:0.0:1781281095.433803:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.433805:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433810:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd21fd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433842:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fc3 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7e9 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433855:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd21fc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7e9 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.433863:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf09fd50, rc 0) 00000100:00100000:0.0:1781281095.434188:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000960c9f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12563:x1867808064772480:12345-192.168.202.40@tcp:101:ps.0 Request processed in 758us (916us total) trans 0 rc 301/301 00000100:00100000:0.0:1781281095.434196:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16387 00000100:00100000:3.0:1781281095.499933:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772544 00000100:00100000:3.0:1781281095.500036:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16388 00000100:00100000:3.0:1781281095.500043:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8bf3be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12429:x1867808064772544:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1781281095.500065:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.500087:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd21fd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7f0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500147:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500162:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500174:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500188:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500195:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500201:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500273:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500280:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500286:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500292:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000071eb48af already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.500296:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500302:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500315:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:3.0:1781281095.500318:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.500322:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500328:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21fdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500346:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500351:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500356:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500362:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000057f793d1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.500364:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500369:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500376:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x7393eb54 (00000000a5baf461) 00010000:00010000:3.0:1781281095.500378:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.500379:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500384:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21fe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500419:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd21fd8 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7f0 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500427:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd21fd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7f0 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.500439:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aa8bb7df, rc 0) 00000100:00100000:3.0:1781281095.500521:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8bf3be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12429:x1867808064772544:12345-192.168.202.40@tcp:101:bash.0 Request processed in 477us (1114us total) trans 0 rc 301/301 00000100:00100000:3.0:1781281095.500528:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16388 00000100:00100000:2.0:1781281095.557118:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.557245:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772608 00000100:00100000:3.0:1781281095.557349:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16389 00000100:00100000:3.0:1781281095.557355:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026a8f5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+501:12565:x1867808064772608:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.557382:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.557408:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd21fed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7f7 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557480:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557508:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557520:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557537:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557575:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557592:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557719:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557729:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557735:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.557793:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e2:0x0]: returning size 11264 00000004:00200000:3.0:1781281095.557797:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281095.557824:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557837:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557844:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557851:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557856:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000057f793d1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.557861:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557869:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557884:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:3.0:1781281095.557887:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.557892:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557897:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd21ff4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557909:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557913:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557917:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557920:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000071eb48af already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.557922:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557926:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557932:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (00000000a5baf461) 00010000:00010000:3.0:1781281095.557934:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.557936:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557944:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd21ffb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.557994:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd21fed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7f7 expref: 503 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.558006:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7f7 expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.558012:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:3.0:1781281095.558014:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.558015:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5856cb, rc 0) 00000100:00100000:3.0:1781281095.558088:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026a8f5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12565:x1867808064772608:12345-192.168.202.40@tcp:101:rm.0 Request processed in 732us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.558096:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16389 00000100:00100000:2.0:1781281095.575032:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.582194:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772736 00000100:00100000:3.0:1781281095.582315:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16390 00000100:00100000:3.0:1781281095.582322:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12565:x1867808064772736:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.582343:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.582364:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a7fe expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.582483:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e2:0x0]: returning size 11264 00010000:00010000:3.0:1781281095.583941:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22009 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7fe expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.584031:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7fe expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.584048:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aa8bb7df, rc 0) 00000100:00100000:3.0:1781281095.584927:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064772736:12345-192.168.202.40@tcp:101:rm.0 Request processed in 2600us (10142us total) trans 4294975643 rc 301/301 00000100:00100000:3.0:1781281095.584939:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16390 00000100:00100000:2.0:1781281095.598747:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772800 00000100:00100000:2.0:1781281095.599050:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4779 00000100:00100000:2.0:1781281095.599058:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003ad285a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064772800:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:2.0:1781281095.622171:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.625082:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064772928 00000100:00100000:3.0:1781281095.625206:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4780 00000100:00100000:3.0:1781281095.625213:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1dad8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064772928:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281095.625701:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1dad8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064772928:12345-192.168.202.40@tcp:35:rm.0 Request processed in 486us (3537us total) trans 4294975644 rc 0/0 00000100:00100000:3.0:1781281095.625709:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4780 00000100:00100000:0.0:1781281095.629430:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.630057:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773056 00000100:00100000:3.0:1781281095.630118:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16391 00000100:00100000:3.0:1781281095.630124:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f275419 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064773056:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.630152:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.630172:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22017 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a805 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.630292:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd2201e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.630306:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd2201e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.630318:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd2201e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.630334:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e2:0x0]: returning size 11264 00010000:00010000:3.0:1781281095.630450:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22017 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a805 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.630468:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd2201e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a805 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.630476:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:3.0:1781281095.630480:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1781281095.630483:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000071eb48af, rc 0) 00000100:00100000:3.0:1781281095.631371:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f275419 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064773056:12345-192.168.202.40@tcp:101:rm.0 Request processed in 1243us (1947us total) trans 4294975645 rc 0/0 00000100:00100000:3.0:1781281095.631380:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16391 00000100:00100000:2.0:1781281095.645622:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.645727:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773120 00000100:00100000:3.0:1781281095.645772:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16392 00000100:00100000:3.0:1781281095.645779:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000059fabcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064773120:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.645821:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.645843:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd2202c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a80c expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.645907:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.645921:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.645933:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.646112:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e4:0x0]: returning size 11264 00000004:00200000:3.0:1781281095.646116:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281095.646140:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.646164:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd2202c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a80c expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.646180:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a80c expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.646187:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:3.0:1781281095.646190:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.646192:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000057f793d1, rc 0) 00000100:00100000:3.0:1781281095.646307:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000059fabcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064773120:12345-192.168.202.40@tcp:101:rm.0 Request processed in 527us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.646314:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16392 00000100:00100000:2.0:1781281095.657293:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.657411:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773184 00000100:00100000:0.0:1781281095.657479:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16393 00000100:00100000:0.0:1781281095.657485:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056c821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:2271:x1867808064773184:12345-192.168.202.40@tcp:101:ll_sa_12565.0 00010000:00010000:0.0:1781281095.657524:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.657577:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2203a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a813 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657637:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657652:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657663:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657676:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657687:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657692:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657813:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657822:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657828:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281095.657864:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e3:0x0]: returning size 11264 00000004:00200000:0.0:1781281095.657868:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281095.657903:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657912:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657918:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657923:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657929:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.657932:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.657939:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658231:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:0.0:1781281095.658235:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.658239:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658245:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658263:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658269:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658274:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658278:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.658280:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658286:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658292:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0xf138ac0d (000000000d7f90d4) 00010000:00010000:0.0:1781281095.658295:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.658296:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658302:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658342:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2203a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a813 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658354:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a813 expref: 508 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.658361:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:0.0:1781281095.658363:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281095.658364:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000906608, rc 0) 00000100:00100000:0.0:1781281095.658420:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056c821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:2271:x1867808064773184:12345-192.168.202.40@tcp:101:ll_sa_12565.0 Request processed in 934us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.658429:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16393 00000100:00100000:0.0:1781281095.659430:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.659695:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773248 00000100:00100000:3.0:1781281095.659771:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4781 00000100:00100000:3.0:1781281095.659778:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6199221 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064773248:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281095.664461:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6199221 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064773248:12345-192.168.202.40@tcp:37:rm.0 Request processed in 4675us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.664478:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4781 00000100:00100000:2.0:1781281095.683325:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.683371:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.683468:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773376 00000100:00100000:0.0:1781281095.683580:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16394 00000100:00100000:0.0:1781281095.683586:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064773376:12345-192.168.202.40@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1781281095.684202:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064773376:12345-192.168.202.40@tcp:501:chlg_load_threa.0 Request processed in 614us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.684212:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16394 00000100:00100000:3.0:1781281095.684886:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773312 00000100:00100000:3.0:1781281095.684931:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4782 00000100:00100000:3.0:1781281095.684936:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e72821 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064773312:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:2.0:1781281095.685902:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773440 00000100:00100000:2.0:1781281095.685952:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16395 00000100:00100000:2.0:1781281095.685958:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe636883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064773440:12345-192.168.202.40@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1781281095.686278:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe636883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064773440:12345-192.168.202.40@tcp:503:chlg_load_threa.0 Request processed in 319us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.686285:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16395 00000100:00100000:3.0:1781281095.687882:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e72821 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064773312:12345-192.168.202.40@tcp:37:rm.0 Request processed in 2940us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.687897:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4782 00000100:00100000:3.0:1781281095.690076:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773504 00000100:00100000:3.0:1781281095.690151:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16396 00000100:00100000:3.0:1781281095.690158:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bedd2be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064773504:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.690519:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bedd2be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064773504:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 360us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.690527:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16396 00000100:00100000:2.0:1781281095.695902:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773632 00000100:00100000:3.0:1781281095.696063:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773568 00000100:00100000:3.0:1781281095.696107:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16397 00000100:00100000:3.0:1781281095.696113:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d8704f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773632:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.696445:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d8704f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773632:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 331us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.696453:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16397 00000100:00100000:3.0:1781281095.696474:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16398 00000100:00100000:3.0:1781281095.696479:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd06a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064773568:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.696488:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.696519:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22056 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a81a expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.696604:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.698736:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.698754:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281095.699076:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773696 00000100:00100000:0.0:1781281095.699128:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16399 00000100:00100000:0.0:1781281095.699135:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086cc0f2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064773696:12345-192.168.202.40@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1781281095.699224:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086cc0f2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064773696:12345-192.168.202.40@tcp:501:chlg_load_threa.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.699230:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16399 00000004:00200000:3.0:1781281095.699382:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f2:0x0]: returning size 11264 00000004:00200000:3.0:1781281095.699387:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281095.699415:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.699450:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22056 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a81a expref: 510 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.699467:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a81a expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.699475:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:3.0:1781281095.699477:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.699480:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000099ffc0e, rc 0) 00000100:00100000:3.0:1781281095.700144:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd06a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064773568:12345-192.168.202.40@tcp:101:rm.0 Request processed in 3662us (5156us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.700152:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16398 00000100:00100000:0.0:1781281095.704030:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.704206:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773760 00000100:00100000:3.0:1781281095.704296:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4783 00000100:00100000:3.0:1781281095.704302:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002184a376 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064773760:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281095.706333:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.712907:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.713072:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773888 00000100:00100000:2.0:1781281095.713169:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16401 00000100:00100000:2.0:1781281095.713176:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000330daff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773888:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.713441:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000330daff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773888:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 264us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.713450:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16401 00000100:00100000:0.0:1781281095.716773:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.716929:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064773952 00000100:00100000:2.0:1781281095.717095:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16402 00000100:00100000:2.0:1781281095.717104:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dd4b340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773952:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.717436:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dd4b340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064773952:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 332us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.717444:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16402 00000100:00100000:3.0:1781281095.720761:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774080 00000100:00100000:3.0:1781281095.720831:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4784 00000100:00100000:3.0:1781281095.720838:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef295e9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064774080:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281095.721243:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef295e9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12565:x1867808064774080:12345-192.168.202.40@tcp:35:rm.0 Request processed in 404us (610us total) trans 4294975646 rc 0/0 00000100:00100000:3.0:1781281095.721250:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4784 00000100:00100000:3.0:1781281095.722316:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.722413:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774144 00000100:00100000:2.0:1781281095.722510:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16403 00000100:00100000:2.0:1781281095.722515:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad433a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064774144:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.722746:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad433a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064774144:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 230us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.722752:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16403 00000100:00100000:2.0:1781281095.725877:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.727399:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774272 00000100:00100000:3.0:1781281095.727450:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774336 00000100:00100000:3.0:1781281095.727474:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16404 00000100:00100000:3.0:1781281095.727479:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a12c3f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+511:12565:x1867808064774272:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281095.727564:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281095.727591:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd2205d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a81a expref: 511 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727624:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087d76b98/0xce40b48e7cd038f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00b3b expref: 510 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727637:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000228a60aa/0xce40b48e7ccffb46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f2:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff38d expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727647:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244a6d2b/0xce40b48e7ccffa89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff347 expref: 508 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727656:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:3.0:1781281095.727670:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000038e8fec/0xce40b48e7cd02b0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c006a3 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727677:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281095.727680:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281095.727711:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727724:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727733:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727748:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727754:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.727760:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281095.727919:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16405 00000100:00100000:0.0:1781281095.727924:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d38a0ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064774336:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.728167:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d38a0ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064774336:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 241us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.728176:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16405 00010000:00010000:3.0:1781281095.729039:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.729053:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.729062:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281095.729603:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5052, 176 off887568 00000004:00200000:3.0:1781281095.730440:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f2:0x0]: returning size 11264 00000004:00010000:3.0:1781281095.730458:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a12c3f4c reply state 00000000c8c8f358 transno 4294975647 ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730510:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730520:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730527:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730533:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aa8bb7df already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.730536:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730563:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730578:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281095.730581:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.730585:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.730591:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd22064 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281095.730600:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a12c3f4c reply state 00000000c8c8f358 transno 4294975647 ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281095.731508:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a12c3f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064774272:12345-192.168.202.40@tcp:36:rm.0 Request processed in 4023us (5636us total) trans 4294975647 rc 0/0 00000100:00100000:3.0:1781281095.731525:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16404 00000100:00100000:0.0:1781281095.731726:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.732233:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774400 00000100:00100000:3.0:1781281095.732293:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16406 00000100:00100000:3.0:1781281095.732297:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000380635f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064774400:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.732578:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000380635f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064774400:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 241us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.732586:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16406 00000100:00100000:2.0:1781281095.735625:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.735712:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774464 00000100:00100000:0.0:1781281095.735770:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16407 00000100:00100000:0.0:1781281095.735783:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c089a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064774464:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1781281095.735813:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.735835:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22079 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a821 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.735928:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.735944:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.735970:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281095.736030:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x20d:0x0]: returning size 12288 00000004:00200000:0.0:1781281095.736033:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281095.736058:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.736081:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22079 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a821 expref: 509 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.736085:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.736094:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x9e0a5f7e (00000000a5baf461) 00010000:00010000:3.0:1781281095.736097:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.736098:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a821 expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.736101:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.736104:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (00000000043cbc03) 00010000:00010000:3.0:1781281095.736107:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (00000000357ab1d0) 00010000:00010000:0.0:1781281095.736107:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.736109:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1781281095.736109:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c770f98, rc 0) 00000100:00100000:0.0:1781281095.736175:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c089a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064774464:12345-192.168.202.40@tcp:101:rm.0 Request processed in 397us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.736182:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16407 00000100:00100000:0.0:1781281095.738321:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.742440:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.742885:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774592 00000100:00100000:0.0:1781281095.742984:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16409 00000100:00100000:0.0:1781281095.742990:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e39e6909 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064774592:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.743294:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e39e6909 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064774592:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 303us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.743306:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16409 00000100:00100000:2.0:1781281095.746853:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.752081:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774720 00000100:00100000:0.0:1781281095.752135:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16410 00000100:00100000:0.0:1781281095.752141:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f53d530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064774720:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.752342:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f53d530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064774720:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 201us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.752351:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16410 00000100:00100000:3.0:1781281095.757485:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df713428 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064774656:12345-192.168.202.40@tcp:37:rm.0 Request processed in 9477us (10630us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.757513:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4785 00000100:00100000:2.0:1781281095.760775:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281095.763972:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281095.764294:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774848 00000100:00100000:0.0:1781281095.764359:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16412 00000100:00100000:0.0:1781281095.764367:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006105ab25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064774848:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.764523:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064774976 00000100:00100000:3.0:1781281095.764573:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4786 00000100:00100000:3.0:1781281095.764578:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c244062b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064774976:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281095.764642:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006105ab25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064774848:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 275us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.764650:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16412 00000100:00100000:3.0:1781281095.764898:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c244062b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064774976:12345-192.168.202.40@tcp:35:rm.0 Request processed in 319us (730us total) trans 4294975648 rc 0/0 00000100:00100000:3.0:1781281095.764908:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4786 00000100:00100000:0.0:1781281095.769154:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.769194:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.769264:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775168 00000100:00100000:3.0:1781281095.769327:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16413 00000100:00100000:3.0:1781281095.769334:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000316a4849 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064775168:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.769632:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000316a4849 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064775168:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 297us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.769641:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16413 00000040:00080000:2.0:1781281095.772178:0:6155:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5053, 176 off887744 00000004:00200000:2.0:1781281095.772247:0:6155:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x20d:0x0]: returning size 12288 00000004:00010000:2.0:1781281095.772266:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009641b39c reply state 000000009c0cd67c transno 4294975649 ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772309:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772315:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772320:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772324:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000002217ff2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.772327:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772331:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772342:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:2.0:1781281095.772344:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.772347:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.772351:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22087 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281095.772357:0:6155:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009641b39c reply state 000000009c0cd67c transno 4294975649 ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281095.772433:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009641b39c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064775104:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2959us (3283us total) trans 4294975649 rc 0/0 00000100:00100000:2.0:1781281095.772445:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16414 00000100:00100000:0.0:1781281095.773927:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281095.776173:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.776190:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x8cffc40b (00000000eb312daa) 00010000:00010000:0.0:1781281095.776193:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.776198:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.776204:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (000000005c561e02) 00010000:00010000:0.0:1781281095.776208:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281095.776299:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775232 00000100:00100000:3.0:1781281095.776350:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775296 00000100:00100000:3.0:1781281095.776378:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16415 00000100:00100000:3.0:1781281095.776385:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed89aa44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064775232:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.777088:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed89aa44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775232:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 702us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.777097:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16415 00000100:00100000:2.0:1781281095.783382:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775360 00000100:00100000:2.0:1781281095.783445:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16417 00000100:00100000:2.0:1781281095.783452:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad99820c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064775360:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.784271:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad99820c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064775360:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 816us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.784282:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16417 00000100:00100000:0.0:1781281095.789028:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.790879:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775488 00000100:00100000:3.0:1781281095.790994:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16418 00000100:00100000:3.0:1781281095.791001:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053173120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064775488:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.791226:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053173120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064775488:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 224us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.791234:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16418 00000100:00100000:3.0:1781281095.794006:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775552 00000100:00100000:3.0:1781281095.794059:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16419 00000100:00100000:3.0:1781281095.794067:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775552:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.794319:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775552:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 251us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.794327:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16419 00000100:00100000:0.0:1781281095.796349:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c0b5aa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064775424:12345-192.168.202.40@tcp:37:rm.0 Request processed in 7067us (7321us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.796365:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4787 00000100:00100000:0.0:1781281095.800324:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775744 00000100:00100000:0.0:1781281095.800524:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4788 00000100:00100000:0.0:1781281095.800532:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2df4452 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064775744:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281095.800997:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2df4452 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064775744:12345-192.168.202.40@tcp:35:rm.0 Request processed in 464us (756us total) trans 4294975650 rc 0/0 00000100:00100000:0.0:1781281095.801005:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4788 00000100:00100000:2.0:1781281095.801413:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775616 00000100:00100000:2.0:1781281095.801463:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16420 00000100:00100000:2.0:1781281095.801467:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d0b8f89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775616:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.801637:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d0b8f89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775616:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 170us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.801644:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16420 00000100:00100000:2.0:1781281095.804891:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775808 00000100:00100000:2.0:1781281095.804989:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16421 00000100:00100000:2.0:1781281095.804997:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5010949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775808:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.805248:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5010949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775808:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 251us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.805257:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16421 00000100:00100000:3.0:1781281095.807114:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064775872 00000100:00100000:3.0:1781281095.807172:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16422 00000100:00100000:3.0:1781281095.807178:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000649acf7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775872:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.807399:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000649acf7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064775872:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 220us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.807407:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16422 00000100:00100000:0.0:1781281095.809311:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.809401:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776000 00000100:00100000:2.0:1781281095.809447:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16423 00000100:00100000:2.0:1781281095.809452:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002184a376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064776000:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281095.809508:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281095.809537:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b47771b/0xce40b48e7cd220a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x200:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a828 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.809595:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bf42897f/0xce40b48e7cd04322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x200:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00e83 expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.809607:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bea0686b/0xce40b48e7cd001c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x200:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff603 expref: 507 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.809786:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032a8c763/0xce40b48e7cd000e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x200:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5af expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.809797:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (00000000b5e9161d) 00010000:00010000:2.0:1781281095.809807:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281095.809906:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.809921:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.809930:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.809944:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.809951:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.809956:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810059:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x200:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810066:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810073:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281095.810753:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5054, 176 off887920 00000004:00200000:3.0:1781281095.810815:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x200:0x0]: returning size 11264 00000004:00010000:3.0:1781281095.810831:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002184a376 reply state 000000002e2acb91 transno 4294975651 ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810873:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810879:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810886:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810892:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aa8bb7df already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.810896:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810903:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810919:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281095.810922:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.810927:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.810933:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281095.810942:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002184a376 reply state 000000002e2acb91 transno 4294975651 ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281095.811045:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002184a376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064776000:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1590us (1737us total) trans 4294975651 rc 0/0 00000100:00100000:3.0:1781281095.811054:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16423 00010000:00010000:2.0:1781281095.814067:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.814086:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xddbda88f (0000000086b5e064) 00010000:00010000:2.0:1781281095.814089:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.814094:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.814099:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (000000001708121e) 00010000:00010000:2.0:1781281095.814101:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281095.814146:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776064 00000100:00100000:3.0:1781281095.814260:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16424 00000100:00100000:3.0:1781281095.814268:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcaf2717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064776064:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.814605:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcaf2717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064776064:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 336us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.814996:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16424 00000100:00100000:2.0:1781281095.815356:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.815877:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776128 00000100:00100000:3.0:1781281095.815926:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16425 00000100:00100000:3.0:1781281095.815931:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000db70d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064776128:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.815950:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.815970:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a82f expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816029:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816043:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x263:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816054:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x263:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.816112:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x263:0x0]: returning size 11264 00000004:00200000:3.0:1781281095.816115:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281095.816146:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x263:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816171:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a82f expref: 509 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816186:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x263:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a82f expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.816193:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000a362d105) 00010000:00010000:3.0:1781281095.816195:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.816198:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007633493e, rc 0) 00000100:00100000:3.0:1781281095.816246:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000db70d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064776128:12345-192.168.202.40@tcp:101:rm.0 Request processed in 314us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.816252:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16425 00000100:00100000:0.0:1781281095.819410:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776192 00000100:00100000:0.0:1781281095.819476:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16426 00000100:00100000:0.0:1781281095.819483:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000325d11ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776192:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.820195:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000325d11ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776192:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 709us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.820204:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16426 00000100:00100000:0.0:1781281095.824249:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776256 00000100:00100000:0.0:1781281095.824301:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4789 00000100:00100000:0.0:1781281095.824308:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064776256:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:2.0:1781281095.828533:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.828960:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776320 00000100:00100000:0.0:1781281095.829020:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16427 00000100:00100000:0.0:1781281095.829028:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d02a0a79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064776320:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.829279:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d02a0a79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064776320:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 250us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.829289:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16427 00000100:00100000:0.0:1781281095.833710:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064776256:12345-192.168.202.40@tcp:37:rm.0 Request processed in 9392us (9728us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.833727:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4789 00000100:00100000:2.0:1781281095.834079:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776384 00000100:00100000:2.0:1781281095.834128:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16428 00000100:00100000:2.0:1781281095.834134:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081ace848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776384:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.834408:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081ace848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776384:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 273us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.834416:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16428 00000100:00100000:2.0:1781281095.841201:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776576 00000100:00100000:2.0:1781281095.841254:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16429 00000100:00100000:2.0:1781281095.841260:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ff57beb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776576:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.841487:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ff57beb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776576:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 225us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.841505:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16429 00000100:00100000:0.0:1781281095.841572:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776512 00000100:00100000:0.0:1781281095.841596:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4790 00000100:00100000:0.0:1781281095.841600:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064776512:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281095.842183:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064776512:12345-192.168.202.40@tcp:35:rm.0 Request processed in 581us (1591us total) trans 4294975652 rc 0/0 00000100:00100000:0.0:1781281095.842191:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4790 00000100:00100000:3.0:1781281095.845011:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776704 00000100:00100000:3.0:1781281095.845075:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16430 00000100:00100000:3.0:1781281095.845083:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f093c9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064776704:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281095.845152:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281095.846104:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x263:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a82f expref: 509 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846129:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002979dc9c/0xce40b48e7cd0bc05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x263:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c037cd expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846144:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e1035e40/0xce40b48e7cd0290c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x263:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005d1 expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846155:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8b07cd0/0xce40b48e7cd0286b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x263:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00592 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846166:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000a362d105) 00010000:00010000:3.0:1781281095.846177:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281095.846209:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846223:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846233:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846248:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846255:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846262:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846366:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846375:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.846382:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281095.847108:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776768 00000100:00100000:0.0:1781281095.847150:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16431 00000100:00100000:0.0:1781281095.847156:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8bf3be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064776768:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.847363:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8bf3be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064776768:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 206us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.847371:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16431 00000100:00100000:2.0:1781281095.849427:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776832 00000100:00100000:2.0:1781281095.849486:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16432 00000100:00100000:2.0:1781281095.849499:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe636883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064776832:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.849777:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe636883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12573:x1867808064776832:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 285us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.849795:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16432 00000040:00080000:3.0:1781281095.850327:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5055, 176 off888096 00000004:00200000:3.0:1781281095.850392:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x263:0x0]: returning size 11264 00000004:00010000:3.0:1781281095.850410:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f093c9ac reply state 00000000f59267e0 transno 4294975653 ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850463:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850470:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850477:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850482:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca72b92a already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.850484:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850505:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850518:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281095.850521:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.850527:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.850532:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd220cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281095.850565:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f093c9ac reply state 00000000f59267e0 transno 4294975653 ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281095.850624:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f093c9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064776704:12345-192.168.202.40@tcp:36:rm.0 Request processed in 5540us (5854us total) trans 4294975653 rc 0/0 00000100:00100000:3.0:1781281095.850632:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16430 00010000:00010000:0.0:1781281095.853379:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.853400:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x2c71d537 (000000003886c019) 00010000:00010000:0.0:1781281095.853404:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.853410:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.853416:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000c8c7ecfb) 00010000:00010000:0.0:1781281095.853419:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281095.854128:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776896 00000100:00100000:3.0:1781281095.854215:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064776960 00000100:00100000:0.0:1781281095.854220:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16433 00000100:00100000:0.0:1781281095.854226:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bedd2be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064776896:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.854245:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16434 00000100:00100000:3.0:1781281095.854248:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d8704f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064776960:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1781281095.854261:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281095.854280:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a836 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854339:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854357:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854367:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281095.854416:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x225:0x0]: returning size 11264 00000004:00200000:3.0:1781281095.854421:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281095.854444:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854471:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd220e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a836 expref: 510 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854486:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a836 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.854503:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:3.0:1781281095.854506:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281095.854508:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ee58c1c, rc 0) 00000100:00100000:0.0:1781281095.854523:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bedd2be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064776896:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 295us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.854531:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d8704f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064776960:12345-192.168.202.40@tcp:101:rm.0 Request processed in 282us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.854531:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16433 00000100:00100000:3.0:1781281095.854536:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16434 00000100:00100000:3.0:1781281095.865065:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777024 00000100:00100000:3.0:1781281095.865134:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16435 00000100:00100000:3.0:1781281095.865140:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086cc0f2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777024:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.865374:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086cc0f2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777024:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 232us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.865383:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16435 00000100:00100000:0.0:1781281095.866693:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777088 00000100:00100000:0.0:1781281095.866734:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4791 00000100:00100000:0.0:1781281095.866739:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd06a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064777088:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281095.869479:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.869580:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777152 00000100:00100000:2.0:1781281095.869638:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16436 00000100:00100000:2.0:1781281095.869645:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fba112ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064777152:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.869884:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fba112ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064777152:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 237us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.869892:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16436 00000100:00100000:0.0:1781281095.872687:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd06a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064777088:12345-192.168.202.40@tcp:37:rm.0 Request processed in 5938us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.872706:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4791 00000100:00100000:0.0:1781281095.873851:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.874101:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777216 00000100:00100000:2.0:1781281095.874154:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16437 00000100:00100000:2.0:1781281095.874160:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013148204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777216:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.874411:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013148204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777216:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 250us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.874420:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16437 00000100:00100000:2.0:1781281095.879588:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777408 00000100:00100000:2.0:1781281095.879659:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16438 00000100:00100000:2.0:1781281095.879666:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d38a0ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777408:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.880084:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d38a0ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777408:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 417us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.880092:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16438 00000100:00100000:0.0:1781281095.880618:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777344 00000100:00100000:0.0:1781281095.880662:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4792 00000100:00100000:0.0:1781281095.880667:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035402f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064777344:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281095.881126:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035402f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064777344:12345-192.168.202.40@tcp:35:rm.0 Request processed in 457us (1838us total) trans 4294975654 rc 0/0 00000100:00100000:0.0:1781281095.881133:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4792 00000100:00100000:2.0:1781281095.882227:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777472 00000100:00100000:2.0:1781281095.882269:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16439 00000100:00100000:2.0:1781281095.882274:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f53d530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064777472:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.882471:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f53d530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064777472:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 195us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.882479:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16439 00000100:00100000:3.0:1781281095.884938:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777600 00000100:00100000:2.0:1781281095.885326:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16440 00000100:00100000:2.0:1781281095.885334:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006105ab25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064777600:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281095.885394:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281095.885420:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd220e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a836 expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885443:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b793c97/0xce40b48e7cd05e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0176d expref: 508 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885457:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000654e7f0a/0xce40b48e7cd01069 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x225:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbeb expref: 507 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885470:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038c1b902/0xce40b48e7cd00fa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x225:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb9e expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885483:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000003ca158ae) 00010000:00010000:2.0:1781281095.885502:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281095.885532:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885584:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885595:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885608:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885614:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885628:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885731:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x225:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885739:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.885744:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281095.886509:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5056, 176 off888272 00000004:00200000:2.0:1781281095.886615:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x225:0x0]: returning size 11264 00000004:00010000:2.0:1781281095.886632:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006105ab25 reply state 000000008feec65a transno 4294975655 ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886675:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886681:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886689:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886696:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281095.886699:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886707:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886719:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:2.0:1781281095.886721:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.886725:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.886730:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd220f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281095.886742:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006105ab25 reply state 000000008feec65a transno 4294975655 ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281095.886814:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006105ab25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064777600:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1479us (3329us total) trans 4294975655 rc 0/0 00000100:00100000:2.0:1781281095.886822:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16440 00000100:00100000:2.0:1781281095.887624:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777664 00000100:00100000:2.0:1781281095.887661:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16441 00000100:00100000:2.0:1781281095.887666:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046ff9db2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064777664:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.887857:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046ff9db2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064777664:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 190us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.887865:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16441 00010000:00010000:2.0:1781281095.888808:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.888823:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xf17aab4e (0000000010bae9cd) 00010000:00010000:2.0:1781281095.888826:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281095.888831:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.888837:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000002ed17150) 00010000:00010000:2.0:1781281095.888839:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281095.893951:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777728 00000100:00100000:0.0:1781281095.894037:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16442 00000100:00100000:0.0:1781281095.894044:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad99820c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064777728:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1781281095.894077:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281095.894101:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22105 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a83d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894164:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894178:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894189:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281095.894248:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1fa:0x0]: returning size 11264 00000004:00200000:0.0:1781281095.894251:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281095.894276:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894299:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22105 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a83d expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894320:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a83d expref: 508 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.894328:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:0.0:1781281095.894331:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281095.894334:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000053486f83, rc 0) 00000100:00100000:0.0:1781281095.894409:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad99820c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064777728:12345-192.168.202.40@tcp:101:rm.0 Request processed in 364us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.894416:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16442 00000100:00100000:3.0:1781281095.895416:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777792 00000100:00100000:3.0:1781281095.895456:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16443 00000100:00100000:3.0:1781281095.895461:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053173120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777792:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.895681:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053173120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777792:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 218us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.895689:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16443 00000100:00100000:0.0:1781281095.901382:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777856 00000100:00100000:0.0:1781281095.901429:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4793 00000100:00100000:0.0:1781281095.901435:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064777856:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281095.902486:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777920 00000100:00100000:3.0:1781281095.902565:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16444 00000100:00100000:3.0:1781281095.902571:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef295e9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064777920:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.907262:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef295e9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064777920:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 4681us (5989us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.907280:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16444 00000100:00100000:3.0:1781281095.915129:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064777984 00000100:00100000:3.0:1781281095.915189:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16445 00000100:00100000:3.0:1781281095.915196:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c244062b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064777984:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.915514:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064777856:12345-192.168.202.40@tcp:37:rm.0 Request processed in 14077us (14759us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.915524:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4793 00000100:00100000:3.0:1781281095.915845:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c244062b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064777984:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 647us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.915855:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16445 00000100:00100000:0.0:1781281095.920115:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.920203:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064778048 00000100:00100000:3.0:1781281095.920261:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16446 00000100:00100000:3.0:1781281095.920268:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e1d94c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064778048:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.920481:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e1d94c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064778048:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 212us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.920488:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16446 00000100:00100000:2.0:1781281095.923216:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.924221:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064778112 00000100:00100000:3.0:1781281095.924283:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16447 00000100:00100000:3.0:1781281095.924289:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064778112:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.924648:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064778112:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 357us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.924657:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16447 00000100:00100000:0.0:1781281095.929860:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.935678:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.935861:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064778368 00000100:00100000:3.0:1781281095.935921:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16448 00000100:00100000:3.0:1781281095.935927:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a98f04e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064778368:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281095.935989:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281095.936016:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd2210c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a83d expref: 509 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936047:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d22bff0f/0xce40b48e7cd03ede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00d25 expref: 508 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936059:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059220df6/0xce40b48e7ccfff1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1fa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff500 expref: 507 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936070:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a66b014e/0xce40b48e7ccffe3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1fa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4b3 expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936080:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000005f778797) 00010000:00010000:3.0:1781281095.936091:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281095.936123:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936137:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936148:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936164:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936170:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936175:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936288:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936296:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.936303:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281095.937091:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5057, 176 off888448 00000004:00200000:3.0:1781281095.937153:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1fa:0x0]: returning size 11264 00000004:00010000:3.0:1781281095.937169:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a98f04e reply state 0000000032321d8d transno 4294975657 ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937212:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937219:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937225:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937231:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007633493e already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281095.937234:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937240:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937252:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281095.937254:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.937257:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.937262:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd22113 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281095.937270:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a98f04e reply state 0000000032321d8d transno 4294975657 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281095.937573:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a98f04e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064778368:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1615us (1874us total) trans 4294975657 rc 0/0 00000100:00100000:3.0:1781281095.937583:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16448 00000100:00100000:2.0:1781281095.946504:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.946583:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281095.946830:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.946847:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xc144154 (00000000a362d105) 00010000:00010000:3.0:1781281095.946850:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.946858:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.946864:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000003ca158ae) 00010000:00010000:3.0:1781281095.946866:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281095.946892:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16449 00000100:00100000:3.0:1781281095.946959:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027eedfb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064778432:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.947224:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027eedfb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064778432:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 266us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.947233:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16449 00000100:00100000:0.0:1781281095.951972:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.952061:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.952323:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4795 00000100:00100000:0.0:1781281095.952331:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004701f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064778560:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281095.952794:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064778624 00000100:00100000:3.0:1781281095.952837:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16451 00000100:00100000:3.0:1781281095.952841:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057ba60f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064778624:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281095.953173:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057ba60f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064778624:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 329us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281095.953180:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16451 00000100:00100000:3.0:1781281095.955328:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.960382:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.961503:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004701f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064778560:12345-192.168.202.40@tcp:37:rm.0 Request processed in 9169us (9537us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.961513:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4795 00000100:00100000:3.0:1781281095.969805:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.969891:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064778880 00000100:00100000:3.0:1781281095.969903:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.969952:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4796 00000100:00100000:0.0:1781281095.969959:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e7a930 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064778880:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281095.970379:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e7a930 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12565:x1867808064778880:12345-192.168.202.40@tcp:35:rm.0 Request processed in 410us (573us total) trans 4294975658 rc 0/0 00000100:00100000:0.0:1781281095.970390:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4796 00000100:00100000:3.0:1781281095.976139:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281095.976187:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281095.976263:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779008 00000100:00100000:0.0:1781281095.976389:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16455 00000100:00100000:0.0:1781281095.976395:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d853dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064779008:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.977067:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d853dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064779008:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 669us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.977076:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16455 00000100:00100000:0.0:1781281095.977098:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16456 00000100:00100000:0.0:1781281095.977102:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026238c76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064779136:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281095.977147:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281095.977177:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd2212f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a844 expref: 509 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977198:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058aa2dad/0xce40b48e7cd06ba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01bc6 expref: 508 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977210:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000045f5ffb5/0xce40b48e7cd01754 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x235:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe8b expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977220:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c663d8f0/0xce40b48e7cd01690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x235:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe3e expref: 506 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977231:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (000000006dd9b0f0) 00010000:00010000:0.0:1781281095.977242:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281095.977275:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977291:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977301:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977316:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977322:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977328:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977444:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977452:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.977458:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281095.980117:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5058, 176 off888624 00000004:00200000:0.0:1781281095.980192:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x235:0x0]: returning size 12288 00000004:00010000:0.0:1781281095.980213:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000026238c76 reply state 0000000079fe5e6b transno 4294975659 ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980257:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980264:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980276:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980282:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281095.980285:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980293:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980307:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:0.0:1781281095.980309:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281095.980313:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281095.980319:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22136 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281095.980330:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000026238c76 reply state 0000000079fe5e6b transno 4294975659 ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281095.980423:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026238c76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064779136:12345-192.168.202.40@tcp:36:rm.0 Request processed in 3317us (4235us total) trans 4294975659 rc 0/0 00000100:00100000:0.0:1781281095.980432:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16456 00000100:00100000:3.0:1781281095.985231:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.985403:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779200 00000100:00100000:2.0:1781281095.985462:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16457 00000100:00100000:2.0:1781281095.985469:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086471465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064779200:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281095.985742:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086471465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064779200:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 272us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281095.985751:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16457 00000100:00100000:2.0:1781281095.989144:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281095.989585:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.989604:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x56ca4f59 (000000000d7f90d4) 00010000:00010000:3.0:1781281095.989607:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281095.989612:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281095.989619:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:3.0:1781281095.989621:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281095.992405:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779264 00000100:00100000:0.0:1781281095.992480:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16458 00000100:00100000:0.0:1781281095.992507:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42aef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064779264:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281095.993054:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42aef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064779264:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 546us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281095.993063:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16458 00000100:00100000:3.0:1781281095.999482:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281095.999742:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779328 00000100:00100000:2.0:1781281095.999806:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16459 00000100:00100000:2.0:1781281095.999813:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063702a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064779328:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1781281095.999839:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281095.999862:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2214b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a84b expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.999927:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.999943:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281095.999955:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281096.000019:0:6155:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x25f:0x0]: returning size 11264 00000004:00200000:2.0:1781281096.000023:0:6155:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281096.000048:0:6155:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.000075:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2214b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a84b expref: 509 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.000091:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a84b expref: 508 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.000099:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000b7eeb9bd) 00010000:00010000:2.0:1781281096.000102:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281096.000105:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d3152b9, rc 0) 00000100:00100000:2.0:1781281096.000184:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063702a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064779328:12345-192.168.202.40@tcp:101:rm.0 Request processed in 362us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.000191:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16459 00000100:00100000:3.0:1781281096.002856:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.002996:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779392 00000100:00100000:0.0:1781281096.003049:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16460 00000100:00100000:0.0:1781281096.003055:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064779392:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281096.003303:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea5ecdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064779392:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 246us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.003311:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16460 00000100:00100000:3.0:1781281096.006826:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.007176:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779456 00000100:00100000:0.0:1781281096.007241:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4797 00000100:00100000:0.0:1781281096.007248:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f529e761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064779456:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.009966:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.010099:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779520 00000100:00100000:2.0:1781281096.010160:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16461 00000100:00100000:2.0:1781281096.010166:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df9eb1f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064779520:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281096.010383:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df9eb1f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12573:x1867808064779520:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.010392:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16461 00000100:00100000:0.0:1781281096.011428:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f529e761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064779456:12345-192.168.202.40@tcp:37:rm.0 Request processed in 4175us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.011439:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4797 00000100:00100000:3.0:1781281096.025338:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.025626:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779584 00000100:00100000:0.0:1781281096.025738:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16462 00000100:00100000:0.0:1781281096.025745:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa625ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064779584:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281096.025965:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa625ebd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064779584:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 218us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.025973:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16462 00000100:00100000:3.0:1781281096.027757:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.029996:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779776 00000100:00100000:2.0:1781281096.030062:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16463 00000100:00100000:2.0:1781281096.030068:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003ad285a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064779776:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281096.030296:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003ad285a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064779776:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 226us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.030305:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16463 00000100:00100000:0.0:1781281096.031384:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.033746:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000040:00080000:2.0:1781281096.034233:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5059, 176 off888800 00000004:00200000:2.0:1781281096.034298:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x25f:0x0]: returning size 11264 00000004:00010000:2.0:1781281096.034318:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d768230d reply state 0000000020889159 transno 4294975661 ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034365:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034372:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034379:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034385:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f3c60d09 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281096.034389:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034398:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034415:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:2.0:1781281096.034418:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.034421:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.034427:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22159 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281096.034437:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d768230d reply state 0000000020889159 transno 4294975661 ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.034810:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d768230d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064779904:12345-192.168.202.40@tcp:36:rm.0 Request processed in 3168us (3428us total) trans 4294975661 rc 0/0 00000100:00100000:2.0:1781281096.034823:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16464 00000100:00100000:2.0:1781281096.034857:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064779968 00000100:00100000:3.0:1781281096.038293:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.038763:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780032 00000100:00100000:2.0:1781281096.038825:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16466 00000100:00100000:2.0:1781281096.038832:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c389b17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064780032:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1781281096.038860:0:6157:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281096.038882:0:6157:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2216e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a852 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.038945:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.038961:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.038972:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281096.039034:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22d:0x0]: returning size 11264 00000004:00200000:2.0:1781281096.039038:0:6157:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281096.039063:0:6157:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.039088:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2216e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a852 expref: 510 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.039106:0:6157:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a852 expref: 509 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.039119:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:2.0:1781281096.039121:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281096.039124:0:6157:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e7699bb8, rc 0) 00000100:00100000:2.0:1781281096.039753:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c389b17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064780032:12345-192.168.202.40@tcp:101:rm.0 Request processed in 919us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.039761:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16466 00000100:00100000:0.0:1781281096.039929:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004701f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064779968:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 4489us (6187us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.039939:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16465 00000100:00100000:3.0:1781281096.042813:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.045666:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.045789:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780224 00000100:00100000:2.0:1781281096.045837:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16468 00000100:00100000:2.0:1781281096.045844:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad433a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064780224:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281096.046051:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad433a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064780224:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 206us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.046059:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16468 00000100:00100000:3.0:1781281096.047708:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.047806:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780160 00000100:00100000:2.0:1781281096.047861:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4799 00000100:00100000:2.0:1781281096.047867:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064780160:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.052726:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.055286:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064780160:12345-192.168.202.40@tcp:37:rm.0 Request processed in 7412us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.055299:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4799 00000100:00100000:3.0:1781281096.062438:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.063026:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.063068:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780352 00000100:00100000:3.0:1781281096.063110:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780416 00000100:00100000:3.0:1781281096.063131:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16470 00000100:00100000:3.0:1781281096.063137:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080b4c913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064780352:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281096.063356:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16471 00000100:00100000:2.0:1781281096.063362:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b4c7326 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12568:x1867808064780416:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.063383:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.063479:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281096.064161:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b4c7326 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12568:x1867808064780416:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 794us (1134us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.064171:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16471 00000100:00100000:3.0:1781281096.064334:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080b4c913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12573:x1867808064780352:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 1196us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.064343:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16470 00000100:00100000:0.0:1781281096.064444:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.064600:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780544 00000100:00100000:3.0:1781281096.064635:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4800 00000100:00100000:3.0:1781281096.064641:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d00440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064780544:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281096.064970:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d00440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12565:x1867808064780544:12345-192.168.202.40@tcp:35:rm.0 Request processed in 327us (525us total) trans 4294975662 rc 0/0 00000100:00100000:3.0:1781281096.064979:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4800 00000100:00100000:3.0:1781281096.070923:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.070962:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.070996:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780672 00000100:00100000:3.0:1781281096.071048:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780736 00000100:00100000:3.0:1781281096.071070:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16472 00000100:00100000:3.0:1781281096.071077:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a634b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+510:12565:x1867808064780672:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.071130:0:6157:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281096.071158:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a852 expref: 510 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071180:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007ea32cf7/0xce40b48e7cd06415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01934 expref: 509 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071206:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096b13d98/0xce40b48e7cd013d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd2d expref: 508 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071222:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd012fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffce0 expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071233:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000003e8e6ae0) 00010000:00010000:3.0:1781281096.071242:0:6157:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.071272:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071287:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071296:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071312:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071319:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071325:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071432:0:6157:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071440:0:6157:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.071451:0:6157:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.071929:0:6157:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5060, 176 off888976 00000004:00200000:3.0:1781281096.071993:0:6157:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22d:0x0]: returning size 11264 00000004:00010000:3.0:1781281096.072010:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002a634b6b reply state 0000000063a9ab8b transno 4294975663 ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072046:0:6157:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072053:0:6157:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072060:0:6157:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072066:0:6157:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007633493e already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.072069:0:6157:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072076:0:6157:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072085:0:6157:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:3.0:1781281096.072087:0:6157:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.072090:0:6157:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.072099:0:6157:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd2217c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.072108:0:6157:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002a634b6b reply state 0000000063a9ab8b transno 4294975663 ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.072183:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a634b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064780672:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1104us (1268us total) trans 4294975663 rc 0/0 00000100:00100000:3.0:1781281096.072191:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16472 00000100:00100000:3.0:1781281096.072216:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16473 00000100:00100000:3.0:1781281096.072221:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008875583 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064780736:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281096.072328:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008875583 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064780736:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 105us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.072335:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16473 00000100:00100000:3.0:1781281096.072401:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.072434:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780800 00000100:00100000:3.0:1781281096.072458:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16474 00000100:00100000:3.0:1781281096.072462:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e7a930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064780800:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.072476:0:6157:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.072536:0:6157:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281096.072583:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e7a930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064780800:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 119us (182us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.072590:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16474 00000100:00100000:2.0:1781281096.076927:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.076968:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780864 00000100:00100000:2.0:1781281096.077020:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16475 00000100:00100000:2.0:1781281096.077026:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064780864:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281096.077872:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0b7d5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12573:x1867808064780864:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 843us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.077882:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16475 00000100:00100000:2.0:1781281096.080698:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.080737:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.080825:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064780928 00000100:00100000:0.0:1781281096.080883:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16476 00000100:00100000:0.0:1781281096.080890:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004892cfef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064780928:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.080923:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3a7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.081022:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3a7:0x0]: rc = -2 00000100:00100000:0.0:1781281096.081085:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004892cfef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064780928:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (394us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.081092:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16476 00000100:00100000:3.0:1781281096.081707:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781056 00000100:00100000:3.0:1781281096.081747:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4801 00000100:00100000:3.0:1781281096.081751:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064781056:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281096.082225:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064781056:12345-192.168.202.40@tcp:35:rm.0 Request processed in 471us (1487us total) trans 4294975664 rc 0/0 00000100:00100000:3.0:1781281096.082233:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4801 00000100:00100000:2.0:1781281096.089287:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.089378:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.089703:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781120 00000100:00100000:0.0:1781281096.089758:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781184 00000100:00100000:0.0:1781281096.089790:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16477 00000100:00100000:0.0:1781281096.089796:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bef838 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064781120:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281096.090021:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bef838 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+509:12573:x1867808064781120:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 224us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.090029:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16477 00000100:00100000:0.0:1781281096.090050:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16478 00000100:00100000:0.0:1781281096.090054:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183cb8ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12568:x1867808064781184:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.090079:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.090163:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281096.090184:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183cb8ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12568:x1867808064781184:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 129us (807us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.090191:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16478 00000100:00100000:2.0:1781281096.090824:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781312 00000100:00100000:2.0:1781281096.090864:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16479 00000100:00100000:2.0:1781281096.090869:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064781312:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281096.090909:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281096.090937:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd0055d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff76f expref: 508 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.090958:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001da655b8/0xce40b48e7cd0304b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00855 expref: 507 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.090969:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cfa6dcf/0xce40b48e7ccffa04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff30f expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.090979:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (00000000bbf8ea12) 00010000:00010000:2.0:1781281096.090995:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd22033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a80c expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091002:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:2.0:1781281096.091005:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281096.091036:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091050:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091059:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091076:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091082:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091087:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091193:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091203:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091209:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281096.091684:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5061, 176 off889152 00000004:00200000:2.0:1781281096.091741:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e5:0x0]: returning size 11264 00000004:00010000:2.0:1781281096.091755:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005853c498 reply state 0000000088e299b4 transno 4294975665 ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091794:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091801:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091807:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091812:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281096.091816:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091821:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091832:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:2.0:1781281096.091834:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.091838:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.091843:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22191 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281096.091856:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005853c498 reply state 0000000088e299b4 transno 4294975665 ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.091926:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005853c498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064781312:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1055us (1281us total) trans 4294975665 rc 0/0 00000100:00100000:2.0:1781281096.091934:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16479 00010000:00010000:3.0:1781281096.094987:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.095009:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xfe8990f0 (00000000521683dc) 00010000:00010000:3.0:1781281096.095011:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.095016:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.095021:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (0000000074f3729b) 00010000:00010000:3.0:1781281096.095023:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281096.098369:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.098511:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.098643:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781504 00000100:00100000:2.0:1781281096.098699:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4802 00000100:00100000:2.0:1781281096.098706:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006917bf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064781504:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:2.0:1781281096.099122:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006917bf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064781504:12345-192.168.202.40@tcp:35:rm.0 Request processed in 415us (611us total) trans 4294975666 rc 0/0 00000100:00100000:2.0:1781281096.099131:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4802 00000100:00100000:3.0:1781281096.104141:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.104233:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781632 00000100:00100000:0.0:1781281096.104372:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.104854:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781696 00000100:00100000:2.0:1781281096.104891:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16481 00000100:00100000:2.0:1781281096.104897:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001771f40e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+508:12565:x1867808064781632:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281096.105115:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281096.105148:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007668feee/0xce40b48e7cd03005 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00847 expref: 508 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105172:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba83ff90/0xce40b48e7ccff4e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff11e expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105184:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7ccff45b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff0fb expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105200:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000c3b69c32) 00010000:00010000:2.0:1781281096.105215:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd22002 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a7f7 expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105223:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:2.0:1781281096.105225:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281096.105255:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105269:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105278:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105293:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105299:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105305:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105430:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105438:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.105449:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.106071:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16482 00000100:00100000:0.0:1781281096.106078:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cdb05f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064781696:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.106103:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1781281096.106222:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cdb05f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064781696:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 144us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.106230:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16482 00000040:00080000:2.0:1781281096.106898:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5062, 176 off889328 00000004:00200000:2.0:1781281096.107160:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e4:0x0]: returning size 11264 00000004:00010000:2.0:1781281096.107181:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001771f40e reply state 00000000833d2472 transno 4294975667 ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107226:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107232:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107238:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107244:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281096.107248:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107255:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107272:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:2.0:1781281096.107275:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.107279:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.107289:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd221a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281096.107299:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001771f40e reply state 00000000833d2472 transno 4294975667 ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.107424:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001771f40e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064781632:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2524us (3289us total) trans 4294975667 rc 0/0 00000100:00100000:2.0:1781281096.107433:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16481 00000100:00100000:2.0:1781281096.111676:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.120384:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.121009:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.121084:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781888 00000100:00100000:2.0:1781281096.121143:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16484 00000100:00100000:2.0:1781281096.121151:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005492779a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064781888:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.121192:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3a8:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.121285:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3a8:0x0]: rc = -2 00000100:00100000:2.0:1781281096.121339:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005492779a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064781888:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.121347:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16484 00000100:00100000:3.0:1781281096.122202:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781824 00000100:00100000:0.0:1781281096.124078:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064781952 00000100:00100000:0.0:1781281096.124135:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16485 00000100:00100000:0.0:1781281096.124140:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2df4452 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064781952:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.124173:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3a9:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.124261:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3a9:0x0]: rc = -2 00000100:00100000:0.0:1781281096.124312:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2df4452 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064781952:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 170us (356us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.124319:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16485 00000100:00100000:0.0:1781281096.127040:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782016 00000100:00100000:0.0:1781281096.127101:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16486 00000100:00100000:0.0:1781281096.127108:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782016:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.127145:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3aa:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.127252:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3aa:0x0]: rc = -2 00000100:00100000:0.0:1781281096.127306:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000108ab855 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782016:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 197us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.127314:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16486 00000100:00100000:3.0:1781281096.127963:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4803 00000100:00100000:3.0:1781281096.127971:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e0fdc77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064781824:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.135194:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e0fdc77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064781824:12345-192.168.202.40@tcp:37:rm.0 Request processed in 7214us (14809us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.135211:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4803 00000100:00100000:0.0:1781281096.136446:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.140057:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782080 00000100:00100000:2.0:1781281096.140129:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16487 00000100:00100000:2.0:1781281096.140137:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e10e5d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064782080:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.140186:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.140278:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281096.140343:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e10e5d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064782080:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 205us (3899us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.140354:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16487 00000100:00100000:2.0:1781281096.142532:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.142637:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782144 00000100:00100000:3.0:1781281096.142689:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4804 00000100:00100000:3.0:1781281096.142696:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026a8f5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064782144:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.151419:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026a8f5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064782144:12345-192.168.202.40@tcp:37:rm.0 Request processed in 8711us (8884us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.151437:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4804 00000100:00100000:0.0:1781281096.158130:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782208 00000100:00100000:0.0:1781281096.158257:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782272 00000100:00100000:0.0:1781281096.158289:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16488 00000100:00100000:0.0:1781281096.158297:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782208:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.158335:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.158430:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281096.158484:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000015fa72a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782208:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 187us (3693us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.159764:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16488 00000100:00100000:3.0:1781281096.163583:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782336 00000100:00100000:3.0:1781281096.163643:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16490 00000100:00100000:3.0:1781281096.163650:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082962502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782336:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.163684:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1781281096.163845:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782400 00000100:00100000:2.0:1781281096.163886:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4805 00000100:00100000:2.0:1781281096.163891:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002798b11a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064782400:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.163901:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082962502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064782336:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 249us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.163910:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16490 00000100:00100000:2.0:1781281096.167434:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002798b11a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064782400:12345-192.168.202.40@tcp:37:rm.0 Request processed in 3538us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.167449:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4805 00000100:00100000:3.0:1781281096.167483:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782464 00000100:00100000:3.0:1781281096.167533:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16491 00000100:00100000:3.0:1781281096.167539:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bae5c93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782464:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.167590:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1781281096.167700:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bae5c93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064782464:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 159us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.167710:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16491 00000100:00100000:2.0:1781281096.172346:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782656 00000100:00100000:2.0:1781281096.172415:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4806 00000100:00100000:2.0:1781281096.172422:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f52a02e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064782656:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:2.0:1781281096.172863:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f52a02e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064782656:12345-192.168.202.40@tcp:35:rm.0 Request processed in 439us (620us total) trans 4294975668 rc 0/0 00000100:00100000:0.0:1781281096.172867:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782528 00000100:00100000:2.0:1781281096.172872:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4806 00000100:00100000:0.0:1781281096.172901:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16492 00000100:00100000:0.0:1781281096.172907:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009993167f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064782528:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.172924:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1781281096.173014:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009993167f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064782528:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 107us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.173022:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16492 00000100:00100000:3.0:1781281096.178162:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782784 00000100:00100000:3.0:1781281096.178224:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16493 00000100:00100000:3.0:1781281096.178232:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079a4af6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064782784:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.178282:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1781281096.178310:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd221c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x232:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a859 expref: 507 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178333:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd068fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x232:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01ad8 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178345:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029682757/0xce40b48e7cd015cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x232:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdf8 expref: 505 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178356:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dcb21329/0xce40b48e7cd01508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x232:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdab expref: 504 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178365:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (00000000d599d343) 00010000:00010000:3.0:1781281096.178379:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000483c103b/0xce40b48e7cd02a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00641 expref: 503 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178387:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:3.0:1781281096.178390:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.178421:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178436:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178446:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178464:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178471:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178478:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178661:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x232:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178670:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.178677:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.179126:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5063, 176 off889504 00000004:00200000:3.0:1781281096.179185:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x232:0x0]: returning size 12288 00000004:00010000:3.0:1781281096.179200:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000079a4af6e reply state 000000005d1c4cb1 transno 4294975669 ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179238:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179245:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179253:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179259:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000893b363e already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.179263:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179271:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179285:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:3.0:1781281096.179288:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.179291:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.179297:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd221c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.179305:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000079a4af6e reply state 000000005d1c4cb1 transno 4294975669 ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.179400:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079a4af6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064782784:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1167us (3056us total) trans 4294975669 rc 0/0 00000100:00100000:3.0:1781281096.179409:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16493 00000100:00100000:0.0:1781281096.194745:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.195025:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782848 00000100:00100000:2.0:1781281096.195088:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16494 00000100:00100000:2.0:1781281096.195096:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d00440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064782848:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.195128:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.195219:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.195273:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d00440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064782848:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (536us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.195281:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16494 00000100:00100000:0.0:1781281096.195826:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281096.199995:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.200012:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x56ca4f59 (000000003e8e6ae0) 00010000:00010000:3.0:1781281096.200015:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.200019:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.200025:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (0000000005a25b42) 00010000:00010000:3.0:1781281096.200027:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281096.202509:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064782976 00000100:00100000:2.0:1781281096.202595:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16496 00000100:00100000:2.0:1781281096.202602:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a87ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064782976:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.202640:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3ab:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.202734:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3ab:0x0]: rc = -2 00000100:00100000:2.0:1781281096.202799:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a87ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064782976:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (4051us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.202807:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16496 00000100:00100000:2.0:1781281096.204290:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783040 00000100:00100000:2.0:1781281096.204335:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4807 00000100:00100000:2.0:1781281096.204341:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6a15290 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064783040:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281096.214702:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783104 00000100:00100000:0.0:1781281096.214764:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16497 00000100:00100000:0.0:1781281096.214771:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001b97ec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064783104:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.214819:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3ac:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.214926:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3ac:0x0]: rc = -2 00000100:00100000:0.0:1781281096.214981:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001b97ec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064783104:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 210us (900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.214993:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16497 00000100:00100000:3.0:1781281096.218332:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.238651:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.238770:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.239585:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783360 00000100:00100000:2.0:1781281096.239620:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4808 00000100:00100000:2.0:1781281096.239625:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080b289a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064783360:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:2.0:1781281096.239945:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080b289a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064783360:12345-192.168.202.40@tcp:35:rm.0 Request processed in 318us (1176us total) trans 4294975670 rc 0/0 00000100:00100000:2.0:1781281096.239953:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4808 00000100:00100000:3.0:1781281096.245854:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.245907:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.246015:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783488 00000100:00100000:0.0:1781281096.246074:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783552 00000100:00100000:0.0:1781281096.246104:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16500 00000100:00100000:0.0:1781281096.246111:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000529dfe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064783488:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.246171:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281096.246207:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd221e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a860 expref: 507 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246235:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005da3a44d/0xce40b48e7cd115d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c055e8 expref: 506 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246247:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062b301b6/0xce40b48e7cd0b79e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c03629 expref: 505 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246261:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f30e098/0xce40b48e7cd025cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004ab expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246270:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (0000000059c32305) 00010000:00010000:0.0:1781281096.246286:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.246321:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246337:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246350:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246371:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246378:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246384:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246513:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246522:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.246529:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.246976:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5064, 176 off889680 00000004:00200000:0.0:1781281096.247030:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x25d:0x0]: returning size 11264 00000004:00010000:0.0:1781281096.247044:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000529dfe6 reply state 00000000738aa4ff transno 4294975671 ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247081:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247088:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247099:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247105:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.247108:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247115:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247126:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:0.0:1781281096.247129:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.247131:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.247136:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd221ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.247147:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000529dfe6 reply state 00000000738aa4ff transno 4294975671 ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.247223:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000529dfe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064783488:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1111us (1379us total) trans 4294975671 rc 0/0 00000100:00100000:0.0:1781281096.247231:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16500 00000100:00100000:0.0:1781281096.247256:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16501 00000100:00100000:0.0:1781281096.247261:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5275744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064783552:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.247283:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3ad:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.247333:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3ad:0x0]: rc = -2 00000100:00100000:0.0:1781281096.247357:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5275744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064783552:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 96us (1450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.247364:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16501 00000100:00100000:3.0:1781281096.254004:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.254120:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783616 00000100:00100000:2.0:1781281096.254177:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16502 00000100:00100000:2.0:1781281096.254183:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016840e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064783616:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.254213:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x3ae:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.254299:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x3ae:0x0]: rc = -2 00000100:00100000:2.0:1781281096.254348:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016840e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064783616:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 165us (354us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.254355:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16502 00000100:00100000:3.0:1781281096.261248:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.261295:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.261383:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783744 00000100:00100000:0.0:1781281096.261589:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16504 00000100:00100000:0.0:1781281096.261594:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000506bba3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064783744:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.261619:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.261717:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281096.261774:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000506bba3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064783744:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.261783:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16504 00000100:00100000:0.0:1781281096.269744:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.271637:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.271837:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16505 00000100:00100000:3.0:1781281096.271846:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000488d7db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064783872:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.271885:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.272060:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281096.272122:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000488d7db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064783872:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 276us (493us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.272130:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16505 00000100:00100000:2.0:1781281096.273308:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064783808 00000100:00100000:2.0:1781281096.273365:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4809 00000100:00100000:2.0:1781281096.273372:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff893dee pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064783808:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281096.275364:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.278801:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.279668:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff893dee pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064783808:12345-192.168.202.40@tcp:37:rm.0 Request processed in 6293us (9932us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.279684:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4809 00000100:00100000:3.0:1781281096.279810:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784000 00000100:00100000:3.0:1781281096.279858:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16507 00000100:00100000:3.0:1781281096.279864:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f1278db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784000:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.279894:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.279978:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281096.280007:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f1278db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784000:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 143us (1214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.280014:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16507 00000100:00100000:0.0:1781281096.287241:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.287330:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.287532:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784192 00000100:00100000:2.0:1781281096.287620:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4810 00000100:00100000:2.0:1781281096.287627:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a804809e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064784192:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:2.0:1781281096.288027:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a804809e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064784192:12345-192.168.202.40@tcp:35:rm.0 Request processed in 398us (695us total) trans 4294975672 rc 0/0 00000100:00100000:2.0:1781281096.288035:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4810 00000100:00100000:0.0:1781281096.291710:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.291791:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.291882:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784320 00000100:00100000:3.0:1781281096.291931:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784384 00000100:00100000:3.0:1781281096.291956:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16509 00000100:00100000:3.0:1781281096.291963:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dd4b340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12565:x1867808064784320:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.292015:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281096.292043:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd22208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a867 expref: 507 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292077:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd048f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0105f expref: 506 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292094:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e4c63c73/0xce40b48e7cd005bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20a:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff799 expref: 505 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292104:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a44802c/0xce40b48e7cd00510 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff75a expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292112:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000577d435b) 00010000:00010000:3.0:1781281096.292122:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.292152:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292167:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292176:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292189:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292196:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292201:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292302:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292311:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292318:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.292788:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5065, 176 off889856 00000004:00200000:3.0:1781281096.292843:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x20a:0x0]: returning size 12288 00000004:00010000:3.0:1781281096.292857:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002dd4b340 reply state 0000000080bd1a87 transno 4294975673 ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292895:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292902:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292909:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292916:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000893b363e already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.292918:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292925:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292937:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:3.0:1781281096.292940:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.292943:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.292948:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2220f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.292956:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002dd4b340 reply state 0000000080bd1a87 transno 4294975673 ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.293024:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dd4b340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064784320:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1061us (1322us total) trans 4294975673 rc 0/0 00000100:00100000:3.0:1781281096.293031:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16509 00000100:00100000:3.0:1781281096.293055:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16510 00000100:00100000:3.0:1781281096.293060:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000380635f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064784384:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.293081:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1781281096.293157:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000380635f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064784384:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 96us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.293164:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16510 00000100:00100000:0.0:1781281096.296788:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.299240:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281096.299454:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.299466:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x8cffc40b (0000000059c32305) 00010000:00010000:3.0:1781281096.299469:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.299473:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.299479:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000d599d343) 00010000:00010000:3.0:1781281096.299481:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281096.304046:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.304154:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.304248:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784640 00000100:00100000:0.0:1781281096.304303:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16513 00000100:00100000:0.0:1781281096.304310:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000059fabcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784640:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.304344:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.304436:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:0.0:1781281096.304505:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000059fabcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784640:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (352us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.304513:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16513 00000100:00100000:3.0:1781281096.304651:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784576 00000100:00100000:3.0:1781281096.304679:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4811 00000100:00100000:3.0:1781281096.304683:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064784576:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.310018:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064784576:12345-192.168.202.40@tcp:37:rm.0 Request processed in 5323us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.310035:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4811 00000100:00100000:2.0:1781281096.310657:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.318229:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.318273:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.318370:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784896 00000100:00100000:0.0:1781281096.318423:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16515 00000100:00100000:0.0:1781281096.318430:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a12c3f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784896:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.318462:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.318631:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:0.0:1781281096.318677:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a12c3f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064784896:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 246us (403us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.318684:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16515 00000100:00100000:3.0:1781281096.319014:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064784832 00000100:00100000:3.0:1781281096.319049:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4812 00000100:00100000:3.0:1781281096.319054:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064784832:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281096.319497:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064784832:12345-192.168.202.40@tcp:35:rm.0 Request processed in 430us (1263us total) trans 4294975674 rc 0/0 00000100:00100000:3.0:1781281096.319506:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4812 00000100:00100000:2.0:1781281096.321308:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.322002:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.332795:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.332856:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785152 00000100:00100000:0.0:1781281096.332922:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16518 00000100:00100000:0.0:1781281096.332929:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1dad8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064785152:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.332960:0:6157:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.333047:0:6157:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:0.0:1781281096.333123:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1dad8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064785152:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 193us (336us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.333131:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16518 00000100:00100000:2.0:1781281096.337323:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.337361:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.337644:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785216 00000100:00100000:0.0:1781281096.337694:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785280 00000100:00100000:0.0:1781281096.337715:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16519 00000100:00100000:0.0:1781281096.337722:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da6e95ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064785216:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1781281096.337748:0:6155:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281096.337767:0:6155:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22247 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a875 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.337835:0:6155:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.337849:0:6155:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.337858:0:6155:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281096.337923:0:6155:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22a:0x0]: returning size 11264 00000004:00200000:0.0:1781281096.337926:0:6155:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281096.337950:0:6155:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.337975:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a875 expref: 507 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.337994:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a875 expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.338000:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:0.0:1781281096.338002:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281096.338004:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc851d66, rc 0) 00000100:00100000:0.0:1781281096.338053:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da6e95ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064785216:12345-192.168.202.40@tcp:101:rm.0 Request processed in 331us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.338061:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16519 00000100:00100000:2.0:1781281096.345985:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.346038:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.346189:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785408 00000100:00100000:0.0:1781281096.346251:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4813 00000100:00100000:0.0:1781281096.346258:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea71fe5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064785408:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.347008:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785344 00000100:00100000:3.0:1781281096.347050:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16521 00000100:00100000:3.0:1781281096.347055:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f85e3586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064785344:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.347085:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1781281096.347171:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f85e3586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064785344:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 115us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.347179:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16521 00000100:00100000:3.0:1781281096.351331:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.351530:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785472 00000100:00100000:2.0:1781281096.351618:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16522 00000100:00100000:2.0:1781281096.351625:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c38bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064785472:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.351660:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1781281096.351789:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c38bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064785472:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 163us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.351797:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16522 00000100:00100000:0.0:1781281096.353768:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea71fe5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064785408:12345-192.168.202.40@tcp:37:rm.0 Request processed in 7502us (7723us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.353783:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4813 00000100:00100000:3.0:1781281096.355392:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.357222:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785536 00000100:00100000:0.0:1781281096.357290:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16523 00000100:00100000:0.0:1781281096.357297:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de5b0821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064785536:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.357330:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1781281096.357464:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de5b0821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064785536:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 166us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.357471:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16523 00000100:00100000:2.0:1781281096.368649:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.368706:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.369107:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785664 00000100:00100000:0.0:1781281096.369162:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4814 00000100:00100000:0.0:1781281096.369169:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064785664:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281096.369612:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064785664:12345-192.168.202.40@tcp:35:rm.0 Request processed in 440us (970us total) trans 4294975676 rc 0/0 00000100:00100000:0.0:1781281096.369621:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4814 00000100:00100000:3.0:1781281096.369958:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785728 00000100:00100000:3.0:1781281096.370001:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16524 00000100:00100000:3.0:1781281096.370006:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064785728:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.370029:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1781281096.370125:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009599263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064785728:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 118us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.370132:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16524 00000100:00100000:2.0:1781281096.372750:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.373074:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785856 00000100:00100000:0.0:1781281096.373132:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16525 00000100:00100000:0.0:1781281096.373139:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064785856:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.373199:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281096.373228:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2224e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a875 expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373256:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000597b3dd/0xce40b48e7cd06201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c01893 expref: 505 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373271:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd01276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffcb6 expref: 504 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373285:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ddb8830/0xce40b48e7cd011b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc69 expref: 503 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373295:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (000000009977072d) 00010000:00010000:0.0:1781281096.373306:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.373343:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373358:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373368:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373386:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373394:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373400:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373530:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373613:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.373620:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.374040:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5067, 176 off890208 00000004:00200000:0.0:1781281096.374094:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x22a:0x0]: returning size 11264 00000004:00010000:0.0:1781281096.374109:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000096df44fa reply state 00000000e2fb2a85 transno 4294975677 ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374146:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374161:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374168:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374174:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.374178:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374187:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374199:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:0.0:1781281096.374202:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.374205:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.374211:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22255 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.374221:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000096df44fa reply state 00000000e2fb2a85 transno 4294975677 ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.374320:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096df44fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064785856:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1180us (1576us total) trans 4294975677 rc 0/0 00000100:00100000:0.0:1781281096.374329:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16525 00000100:00100000:0.0:1781281096.376840:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785920 00000100:00100000:0.0:1781281096.376901:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16526 00000100:00100000:0.0:1781281096.376909:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b2919bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064785920:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.376940:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1781281096.377068:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b2919bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064785920:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.377076:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16526 00000100:00100000:3.0:1781281096.380038:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.380126:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064785984 00000100:00100000:2.0:1781281096.380182:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16527 00000100:00100000:2.0:1781281096.380190:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ebd54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064785984:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1781281096.380215:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281096.380235:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2226a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a87c expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380291:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380307:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380318:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281096.380375:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1ff:0x0]: returning size 11264 00000004:00200000:2.0:1781281096.380379:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1781281096.380404:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380435:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd2226a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a87c expref: 506 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380453:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a87c expref: 505 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.380461:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:2.0:1781281096.380464:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1781281096.380466:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008c473751, rc 0) 00000100:00100000:2.0:1781281096.380537:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ebd54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064785984:12345-192.168.202.40@tcp:101:rm.0 Request processed in 346us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.380578:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16527 00000100:00100000:2.0:1781281096.388677:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.388806:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786048 00000100:00100000:0.0:1781281096.388862:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4815 00000100:00100000:0.0:1781281096.388869:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df713428 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786048:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1781281096.390966:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.391040:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786112 00000100:00100000:0.0:1781281096.391089:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16528 00000100:00100000:0.0:1781281096.391096:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061a0178c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064786112:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.391130:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1781281096.391264:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061a0178c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+507:12568:x1867808064786112:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 169us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.391273:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16528 00000100:00100000:0.0:1781281096.394310:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df713428 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786048:12345-192.168.202.40@tcp:37:rm.0 Request processed in 5434us (5633us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.394327:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4815 00000100:00100000:2.0:1781281096.404711:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786176 00000100:00100000:2.0:1781281096.404773:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16529 00000100:00100000:2.0:1781281096.404780:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f30785b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786176:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.404813:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1781281096.404960:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f30785b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786176:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281096.404968:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16529 00000100:00100000:3.0:1781281096.414691:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.414879:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.414961:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786368 00000100:00100000:3.0:1781281096.415052:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16530 00000100:00100000:3.0:1781281096.415060:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bde703fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786368:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.415095:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1781281096.415248:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bde703fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786368:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.415255:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16530 00000100:00100000:0.0:1781281096.415867:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786304 00000100:00100000:0.0:1781281096.415909:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4816 00000100:00100000:0.0:1781281096.415914:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786304:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281096.419179:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3fd5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064786304:12345-192.168.202.40@tcp:35:rm.0 Request processed in 3256us (4636us total) trans 4294975678 rc 0/0 00000100:00100000:0.0:1781281096.419192:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4816 00000100:00100000:2.0:1781281096.421480:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786432 00000100:00100000:2.0:1781281096.421818:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16531 00000100:00100000:2.0:1781281096.421825:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c0da9d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064786432:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.421859:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.421952:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:2.0:1781281096.422006:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c0da9d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064786432:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 180us (3048us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.422014:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16531 00000100:00100000:3.0:1781281096.422416:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786560 00000100:00100000:3.0:1781281096.422452:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16532 00000100:00100000:3.0:1781281096.422457:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000947429a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064786560:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.422509:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281096.422539:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c473751/0xce40b48e7cd22271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a87c expref: 506 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422583:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26bd14f/0xce40b48e7cd042f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00e75 expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422602:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd0010b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1ff:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5b6 expref: 504 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422613:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd00040 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1ff:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff577 expref: 503 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422623:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (0000000083d40933) 00010000:00010000:3.0:1781281096.422634:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.422661:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422675:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422685:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422699:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422706:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422712:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422910:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422925:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.422932:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.423323:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5068, 176 off890384 00000004:00200000:3.0:1781281096.423374:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1ff:0x0]: returning size 11264 00000004:00010000:3.0:1781281096.423388:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000947429a4 reply state 00000000f585f7cd transno 4294975679 ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423424:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423432:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423440:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423447:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000893b363e already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.423451:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423458:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423469:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:3.0:1781281096.423472:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.423475:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.423481:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd22278 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.423503:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000947429a4 reply state 00000000f585f7cd transno 4294975679 ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.423604:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000947429a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064786560:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1145us (1256us total) trans 4294975679 rc 0/0 00000100:00100000:3.0:1781281096.423613:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16532 00000100:00100000:0.0:1781281096.424570:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786624 00000100:00100000:0.0:1781281096.424611:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16533 00000100:00100000:0.0:1781281096.424616:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000507bd843 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064786624:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.424642:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.424710:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:0.0:1781281096.424756:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000507bd843 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064786624:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 139us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.424765:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16533 00010000:00010000:3.0:1781281096.427342:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.427360:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xddbda88f (00000000577d435b) 00010000:00010000:3.0:1781281096.427363:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.427367:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.427374:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (00000000cfbe4258) 00010000:00010000:3.0:1781281096.427376:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281096.427429:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786688 00000100:00100000:0.0:1781281096.427475:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16534 00000100:00100000:0.0:1781281096.427483:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000702cadf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064786688:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1781281096.427514:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281096.427533:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2228d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a883 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427623:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x222:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427636:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427646:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281096.427704:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x222:0x0]: returning size 11264 00000004:00200000:0.0:1781281096.427708:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281096.427729:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427755:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2228d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a883 expref: 506 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427774:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x222:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a883 expref: 505 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.427780:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (0000000096f4694f) 00010000:00010000:0.0:1781281096.427782:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281096.427784:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc851d66, rc 0) 00000100:00100000:0.0:1781281096.427829:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000702cadf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786688:12345-192.168.202.40@tcp:101:rm.0 Request processed in 346us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.427836:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16534 00000100:00100000:2.0:1781281096.428469:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786752 00000100:00100000:2.0:1781281096.428513:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16535 00000100:00100000:2.0:1781281096.428518:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066a8f277 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786752:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.428580:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.428664:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:2.0:1781281096.428696:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066a8f277 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786752:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.428704:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16535 00000100:00100000:2.0:1781281096.433347:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.433391:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.433458:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786816 00000100:00100000:0.0:1781281096.433522:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16536 00000100:00100000:0.0:1781281096.433528:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008630f8a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786816:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.433588:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.433688:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:0.0:1781281096.433740:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008630f8a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064786816:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 211us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.433747:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16536 00000100:00100000:3.0:1781281096.434149:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064786880 00000100:00100000:3.0:1781281096.434184:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4817 00000100:00100000:3.0:1781281096.434188:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000323ceb23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786880:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281096.436136:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.439223:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.439990:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000323ceb23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064786880:12345-192.168.202.40@tcp:37:rm.0 Request processed in 5798us (6597us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281096.440005:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4817 00000100:00100000:0.0:1781281096.446228:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.446282:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.447597:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064787136 00000100:00100000:3.0:1781281096.447643:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4818 00000100:00100000:3.0:1781281096.447649:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004d10a45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064787136:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1781281096.448055:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004d10a45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064787136:12345-192.168.202.40@tcp:35:rm.0 Request processed in 405us (1837us total) trans 4294975680 rc 0/0 00000100:00100000:3.0:1781281096.448063:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4818 00000100:00100000:0.0:1781281096.450341:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.451508:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.455355:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.455462:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064787456 00000100:00100000:0.0:1781281096.455527:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16542 00000100:00100000:0.0:1781281096.455533:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e59c31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064787456:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.455600:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.455700:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:0.0:1781281096.455768:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e59c31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064787456:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 233us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.455783:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16542 00000100:00100000:2.0:1781281096.457747:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.459476:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.459586:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064787584 00000100:00100000:0.0:1781281096.459632:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16544 00000100:00100000:0.0:1781281096.459638:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009493d817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064787584:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.459666:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.459769:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:0.0:1781281096.459835:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009493d817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064787584:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (364us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.459844:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16544 00000100:00100000:2.0:1781281096.463727:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.467092:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.468209:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c6e68e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064787648:12345-192.168.202.40@tcp:37:rm.0 Request processed in 4050us (4487us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.468220:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4819 00000100:00100000:3.0:1781281096.470706:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.472061:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.475621:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.475687:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064787968 00000100:00100000:0.0:1781281096.475740:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16547 00000100:00100000:0.0:1781281096.475756:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064787968:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.475794:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.475892:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.475965:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9597bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064787968:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 211us (354us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.475972:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16547 00000100:00100000:2.0:1781281096.476216:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788096 00000100:00100000:2.0:1781281096.476262:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16548 00000100:00100000:2.0:1781281096.476266:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d16af03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064788096:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281096.476314:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281096.476345:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd222b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a88a expref: 506 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476365:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000427a4f84/0xce40b48e7cd03dfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00cd1 expref: 505 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476386:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033d520d4/0xce40b48e7ccffe5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4ba expref: 504 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476400:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005bd3250d/0xce40b48e7ccffd92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff47b expref: 503 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476413:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (00000000b066afb7) 00010000:00010000:2.0:1781281096.476426:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281096.476460:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476475:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476484:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476512:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476518:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476529:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476666:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476685:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.476691:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281096.477170:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5070, 176 off890736 00000004:00200000:2.0:1781281096.477314:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f9:0x0]: returning size 11264 00000004:00010000:2.0:1781281096.477331:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001d16af03 reply state 0000000057df52a7 transno 4294975683 ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.477373:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.477382:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.477388:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.477394:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281096.477397:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.477404:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.478451:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:2.0:1781281096.478457:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.478672:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.478872:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281096.478887:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001d16af03 reply state 0000000057df52a7 transno 4294975683 ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.478988:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d16af03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064788096:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2718us (2816us total) trans 4294975683 rc 0/0 00000100:00100000:2.0:1781281096.478997:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16548 00000100:00100000:2.0:1781281096.480341:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788160 00000100:00100000:2.0:1781281096.480395:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16549 00000100:00100000:2.0:1781281096.480401:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027c1fa04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064788160:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.480434:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.480539:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.480604:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027c1fa04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064788160:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 202us (975us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.480612:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16549 00010000:00010000:0.0:1781281096.482746:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.482771:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xc144154 (00000000734ca10d) 00010000:00010000:0.0:1781281096.482776:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.482782:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.482788:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (0000000092ffa8ed) 00010000:00010000:0.0:1781281096.482789:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281096.485867:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788224 00000100:00100000:0.0:1781281096.485932:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16550 00000100:00100000:0.0:1781281096.485938:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007748dca2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064788224:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1781281096.485969:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281096.485991:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd222d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a891 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486053:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486068:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486078:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281096.486144:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f1:0x0]: returning size 11264 00000004:00200000:0.0:1781281096.486148:0:6158:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281096.486168:0:6158:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486189:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd222d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a891 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486205:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a891 expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.486213:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:0.0:1781281096.486216:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281096.486218:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000076930d14, rc 0) 00000100:00100000:0.0:1781281096.486292:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007748dca2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064788224:12345-192.168.202.40@tcp:101:rm.0 Request processed in 353us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.486302:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16550 00000100:00100000:3.0:1781281096.487688:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.488041:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788288 00000100:00100000:2.0:1781281096.488089:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16551 00000100:00100000:2.0:1781281096.488095:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788288:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.488129:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.488224:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:2.0:1781281096.488270:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e8555b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788288:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 174us (589us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.488281:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16551 00000100:00100000:3.0:1781281096.496126:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.496185:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.496603:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788416 00000100:00100000:2.0:1781281096.496648:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16552 00000100:00100000:2.0:1781281096.496655:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788416:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.496688:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.496783:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f2:0x0]: rc = -2 00000100:00100000:2.0:1781281096.496835:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087285398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788416:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (661us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.496843:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16552 00000100:00100000:0.0:1781281096.496928:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788352 00000100:00100000:0.0:1781281096.496962:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4821 00000100:00100000:0.0:1781281096.496966:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064788352:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:0.0:1781281096.501236:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064788352:12345-192.168.202.40@tcp:37:rm.0 Request processed in 4266us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.501250:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4821 00000100:00100000:3.0:1781281096.501570:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788480 00000100:00100000:3.0:1781281096.501610:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16553 00000100:00100000:3.0:1781281096.501615:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005235485d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788480:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.501645:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.501733:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.501772:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005235485d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064788480:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 156us (1125us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.501778:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16553 00000100:00100000:3.0:1781281096.510287:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.510471:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788608 00000100:00100000:0.0:1781281096.510568:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4822 00000100:00100000:0.0:1781281096.510575:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064788608:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281096.510960:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064788608:12345-192.168.202.40@tcp:35:rm.0 Request processed in 384us (683us total) trans 4294975684 rc 0/0 00000100:00100000:0.0:1781281096.510968:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4822 00000100:00100000:0.0:1781281096.511006:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788672 00000100:00100000:0.0:1781281096.511036:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16554 00000100:00100000:0.0:1781281096.511041:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a382e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064788672:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.511063:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.511135:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.511172:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a382e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12568:x1867808064788672:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 130us (188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.511178:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16554 00000100:00100000:3.0:1781281096.513644:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788800 00000100:00100000:3.0:1781281096.513691:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16555 00000100:00100000:3.0:1781281096.513697:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000623e19f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064788800:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.513749:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1781281096.513775:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd222da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a891 expref: 506 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513797:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a35aa556/0xce40b48e7cd038cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00b2d expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513809:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a649bf4/0xce40b48e7ccffb2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff386 expref: 504 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513821:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e7b8f230/0xce40b48e7ccffa74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff340 expref: 503 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513831:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000089969889) 00010000:00010000:3.0:1781281096.513839:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.513869:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513882:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513892:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513905:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513910:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.513915:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514034:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514042:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514048:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.514432:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788864 00000100:00100000:2.0:1781281096.514468:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16556 00000100:00100000:2.0:1781281096.514473:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064788864:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000040:00080000:3.0:1781281096.514477:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5071, 176 off890912 00000004:00000080:2.0:1781281096.514508:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00200000:3.0:1781281096.514567:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1f1:0x0]: returning size 11264 00000004:00010000:3.0:1781281096.514582:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000623e19f1 reply state 000000006d8c78f2 transno 4294975685 ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00000080:2.0:1781281096.514583:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00010000:00010000:3.0:1781281096.514617:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514624:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514631:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.514635:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d734d079 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064788864:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 159us (303us total) trans 0 rc -2/-2 00010000:00010000:3.0:1781281096.514648:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002a5856cb already unused, calling callback (00000000bff7e25e) 00000100:00100000:2.0:1781281096.514650:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16556 00010000:00010000:3.0:1781281096.514652:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514661:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514674:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:3.0:1781281096.514677:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.514679:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.514686:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd222e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.514694:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000623e19f1 reply state 000000006d8c78f2 transno 4294975685 ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.514743:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000623e19f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064788800:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1045us (1230us total) trans 4294975685 rc 0/0 00000100:00100000:3.0:1781281096.514750:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16555 00000100:00100000:3.0:1781281096.518760:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.518832:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.518898:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064788992 00000100:00100000:0.0:1781281096.518946:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4823 00000100:00100000:0.0:1781281096.518953:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e12b0851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064788992:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1781281096.519348:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e12b0851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064788992:12345-192.168.202.40@tcp:35:rm.0 Request processed in 394us (596us total) trans 4294975686 rc 0/0 00000100:00100000:0.0:1781281096.519358:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4823 00010000:00010000:2.0:1781281096.519522:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.519536:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x9e0a5f7e (00000000e01e8158) 00010000:00010000:2.0:1781281096.519560:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.519566:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.519572:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000042cdde64) 00010000:00010000:2.0:1781281096.519574:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281096.525641:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.525850:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789120 00000100:00100000:2.0:1781281096.525905:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16558 00000100:00100000:2.0:1781281096.525912:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064789120:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.525946:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.526034:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.526100:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d865ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064789120:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (468us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.526108:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16558 00000100:00100000:2.0:1781281096.526197:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.526265:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789248 00000100:00100000:2.0:1781281096.526285:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16559 00000100:00100000:2.0:1781281096.526289:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000750bbdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064789248:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1781281096.526334:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1781281096.526362:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4996459/0xce40b48e7cd0044c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff714 expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526383:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3fabac7/0xce40b48e7cd03075 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00863 expref: 504 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526396:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000091a9d908/0xce40b48e7ccff9b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff308 expref: 503 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526407:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000084bd9cd4) 00010000:00010000:2.0:1781281096.526421:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd2204f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a813 expref: 502 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526437:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:2.0:1781281096.526440:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281096.526467:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526481:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526501:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526515:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526521:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526528:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526646:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526655:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.526662:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1781281096.527064:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5072, 176 off891088 00000004:00200000:2.0:1781281096.527120:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e6:0x0]: returning size 11264 00000004:00010000:2.0:1781281096.527136:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000750bbdb5 reply state 000000007c9a9a2f transno 4294975687 ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527172:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527179:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527185:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527191:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:2.0:1781281096.527194:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527202:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527212:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000f6f4f30b) 00010000:00010000:2.0:1781281096.527215:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.527218:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.527223:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046b443e6/0xce40b48e7cd222f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1781281096.527236:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000750bbdb5 reply state 000000007c9a9a2f transno 4294975687 ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281096.527297:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000750bbdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064789248:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1006us (1100us total) trans 4294975687 rc 0/0 00000100:00100000:2.0:1781281096.527306:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16559 00000100:00100000:2.0:1781281096.530179:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.530287:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789312 00000100:00100000:3.0:1781281096.530340:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16560 00000100:00100000:3.0:1781281096.530348:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e65d4570 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064789312:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.530384:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.530476:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.530894:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e65d4570 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064789312:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 545us (721us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.530902:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16560 00010000:00010000:0.0:1781281096.531737:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.531754:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xfe8990f0 (000000005724f5bf) 00010000:00010000:0.0:1781281096.531756:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.531761:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.531767:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000036ea2b0b) 00010000:00010000:0.0:1781281096.531780:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281096.531959:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.537168:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.537322:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789504 00000100:00100000:3.0:1781281096.537365:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16561 00000100:00100000:3.0:1781281096.537370:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000566d15ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064789504:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.537398:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.537482:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.537562:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000566d15ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064789504:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 169us (373us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.537569:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16561 00000100:00100000:0.0:1781281096.540519:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.547119:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.547208:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281096.548038:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548044:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548050:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba10c2d7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281096.548053:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548060:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548072:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:1.0:1781281096.548074:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281096.548078:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548083:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22327 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548091:0:6155:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548096:0:6155:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548101:0:6155:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548106:0:6155:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087ca9abb already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281096.548107:0:6155:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548113:0:6155:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548119:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (00000000363394ee) 00010000:00010000:1.0:1781281096.548121:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281096.548123:0:6155:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548127:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd2232e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548152:0:6155:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b4973da9/0xce40b48e7cd22320 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a898 expref: 505 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548162:0:6155:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000bea0686b/0xce40b48e7cd22335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a898 expref: 504 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.548168:0:6155:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:1.0:1781281096.548169:0:6155:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1781281096.548171:0:6155:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bea0686b, rc 0) 00000100:00100000:1.0:1781281096.548199:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b36a2193 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064789760:12345-192.168.202.40@tcp:101:rm.0 Request processed in 465us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281096.548205:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16564 00000100:00100000:2.0:1781281096.551790:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.551841:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.551932:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789888 00000100:00100000:1.0:1781281096.551985:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4825 00000100:00100000:1.0:1781281096.551991:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b00f37b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064789888:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:1.0:1781281096.552257:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b00f37b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064789888:12345-192.168.202.40@tcp:35:rm.0 Request processed in 264us (473us total) trans 4294975690 rc 0/0 00000100:00100000:1.0:1781281096.552266:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4825 00000100:00100000:3.0:1781281096.552863:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064789952 00000100:00100000:3.0:1781281096.552901:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16565 00000100:00100000:3.0:1781281096.552906:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b946b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064789952:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.552926:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.552999:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.553031:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b946b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12568:x1867808064789952:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 125us (1190us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.553038:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16565 00000100:00100000:2.0:1781281096.557772:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.557914:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.562705:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790080 00000100:00100000:0.0:1781281096.563937:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790144 00000100:00100000:3.0:1781281096.564027:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16566 00000100:00100000:3.0:1781281096.564034:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f67edc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+506:12565:x1867808064790080:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.564094:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1781281096.564120:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bea0686b/0xce40b48e7cd22335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a898 expref: 506 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.564142:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071eb48af/0xce40b48e7cd2201e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a805 expref: 505 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.564151:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000d94dae32) 00010000:00010000:3.0:1781281096.564166:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003111fe9e/0xce40b48e7cd21e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a74f expref: 504 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.564174:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (000000001a8ba6c5) 00010000:00010000:3.0:1781281096.566891:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.566956:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.566979:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.566992:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567003:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567009:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567014:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567124:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567131:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567137:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.567604:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5074, 176 off891440 00000004:00200000:3.0:1781281096.567660:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1e2:0x0]: returning size 11264 00000004:00010000:3.0:1781281096.567673:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f67edc1e reply state 000000003cfc757c transno 4294975691 ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567709:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567715:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567721:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567726:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002a5856cb already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.567729:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567735:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567746:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (00000000b015704c) 00010000:00010000:3.0:1781281096.567749:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.567752:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.567758:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2233c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.567786:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f67edc1e reply state 000000003cfc757c transno 4294975691 ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.567900:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f67edc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+505:12565:x1867808064790080:12345-192.168.202.40@tcp:36:rm.0 Request processed in 3863us (10133us total) trans 4294975691 rc 0/0 00000100:00100000:3.0:1781281096.567908:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16566 00000100:00100000:3.0:1781281096.567941:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16567 00000100:00100000:3.0:1781281096.567947:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f82533d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064790144:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.567972:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.568014:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.568053:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f82533d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12568:x1867808064790144:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 107us (10140us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.568060:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16567 00010000:00010000:0.0:1781281096.570140:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.570158:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (000000002058a2b6) 00010000:00010000:0.0:1781281096.570160:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.570165:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.570171:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000b49ac97e) 00010000:00010000:0.0:1781281096.570173:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281096.571331:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.571415:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790272 00000100:00100000:3.0:1781281096.571467:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16568 00000100:00100000:3.0:1781281096.571473:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d38e711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064790272:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1781281096.571570:0:14242:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1781281096.571597:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007691b582/0xce40b48e7cd02435 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00403 expref: 504 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571619:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9216f3b/0xce40b48e7ccfeb86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee15 expref: 503 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571630:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000077d2e512/0xce40b48e7ccfeb71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1dc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee0e expref: 502 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571644:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dc:0x0].0x0 (000000009a68fcbd) 00010000:00010000:3.0:1781281096.571651:0:14242:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1781281096.571685:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571696:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571705:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571715:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571722:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571728:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571822:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571830:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.571837:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1781281096.572184:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].448, 64 off36992 00000004:00080000:3.0:1781281096.572193:0:14242:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 619276650194ns, next at 620276646140ns, rc = 0 00000040:00080000:3.0:1781281096.572213:0:14242:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5075, 184 off891624 00010000:00010000:3.0:1781281096.572272:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572280:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572288:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572296:0:14242:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572302:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572308:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572727:0:14242:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1781281096.572751:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d38e711 reply state 0000000007fad6d1 transno 4294975692 ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572802:0:14242:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572814:0:14242:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572821:0:14242:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572827:0:14242:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001aa99184 already unused, calling callback (00000000bff7e25e) 00010000:00010000:3.0:1781281096.572830:0:14242:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572837:0:14242:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572847:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (00000000e8ce8eaa) 00010000:00010000:3.0:1781281096.572850:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1781281096.572854:0:14242:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.572860:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001aa99184/0xce40b48e7cd22351 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1781281096.572874:0:14242:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d38e711 reply state 0000000007fad6d1 transno 4294975692 ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.572952:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d38e711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064790272:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1477us (1637us total) trans 4294975692 rc 0/0 00000100:00100000:3.0:1781281096.572960:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16568 00010000:00010000:1.0:1781281096.573160:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281096.573166:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.573173:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009f6dc9ac already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281096.573175:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.573181:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.573191:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dc:0x0].0x0 (000000008a595136) 00010000:00010000:1.0:1781281096.573194:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1781281096.573196:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.573201:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009f6dc9ac/0xce40b48e7cd22366 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436547703232 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.573212:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281096.573214:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281096.573215:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281096.573691:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.573829:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790336 00000100:00100000:3.0:1781281096.573870:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16569 00000100:00100000:3.0:1781281096.573876:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c67f8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790336:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.573905:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.573975:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.574091:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c67f8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790336:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 214us (402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.574100:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16569 00010000:00010000:1.0:1781281096.576857:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.576880:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xaaaf1035 (00000000d7784fdf) 00010000:00010000:1.0:1781281096.576883:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281096.576889:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.576896:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dc:0x0].0x0 (000000008a595136) 00010000:00010000:1.0:1781281096.576898:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281096.580619:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.580875:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790400 00000100:00100000:1.0:1781281096.580934:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16570 00000100:00100000:1.0:1781281096.580940:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017565c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790400:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.581000:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.581088:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.581151:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017565c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790400:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.581160:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16570 00000100:00100000:0.0:1781281096.588270:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.588471:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790464 00000100:00100000:1.0:1781281096.588573:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16571 00000100:00100000:1.0:1781281096.588582:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790464:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.588624:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.588713:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:1.0:1781281096.588777:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dda2bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790464:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.588786:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16571 00000100:00100000:2.0:1781281096.593329:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.593639:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790528 00000100:00100000:1.0:1781281096.593693:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16572 00000100:00100000:1.0:1781281096.593701:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006618ba35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790528:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.593736:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.593829:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:1.0:1781281096.593887:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006618ba35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790528:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 186us (568us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.593895:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16572 00000100:00100000:2.0:1781281096.603406:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.603507:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790592 00000100:00100000:1.0:1781281096.603605:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16573 00000100:00100000:1.0:1781281096.603612:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000986313b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790592:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.603645:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.603739:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.603808:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000986313b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790592:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (409us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.603815:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16573 00000100:00100000:0.0:1781281096.612304:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.612422:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790656 00000100:00100000:3.0:1781281096.612480:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16574 00000100:00100000:3.0:1781281096.612506:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790656:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.612605:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.612709:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.612779:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630ea1cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790656:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 272us (483us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.612789:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16574 00000100:00100000:2.0:1781281096.615654:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.615749:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790720 00000100:00100000:1.0:1781281096.615804:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16575 00000100:00100000:1.0:1781281096.615810:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ff09754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790720:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.615866:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.615954:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:1.0:1781281096.616004:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ff09754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790720:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 193us (357us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.616012:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16575 00000100:00100000:2.0:1781281096.618849:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.618941:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790784 00000100:00100000:3.0:1781281096.618996:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16576 00000100:00100000:3.0:1781281096.619004:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051e439c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790784:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.619037:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.619130:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.619193:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051e439c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790784:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (354us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.619201:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16576 00000100:00100000:0.0:1781281096.621666:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.621785:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790848 00000100:00100000:1.0:1781281096.621833:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16577 00000100:00100000:1.0:1781281096.621839:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cccad6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790848:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.621871:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.621955:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.622003:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cccad6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790848:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 164us (344us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.622015:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16577 00000100:00100000:2.0:1781281096.628911:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.629000:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790912 00000100:00100000:3.0:1781281096.629053:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16578 00000100:00100000:3.0:1781281096.629059:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000322c3733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790912:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.629097:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.629204:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.629263:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000322c3733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790912:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 202us (359us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.629272:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16578 00000100:00100000:0.0:1781281096.642922:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.643020:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064790976 00000100:00100000:1.0:1781281096.643075:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16579 00000100:00100000:1.0:1781281096.643082:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c26a65ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790976:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.643115:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.643210:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:1.0:1781281096.643269:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c26a65ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064790976:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 187us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.643278:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16579 00000100:00100000:0.0:1781281096.646464:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.646597:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791040 00000100:00100000:3.0:1781281096.646645:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16580 00000100:00100000:3.0:1781281096.646651:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e8b98a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791040:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.646682:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.646766:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.646839:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e8b98a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791040:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 187us (382us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.646847:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16580 00000100:00100000:2.0:1781281096.649616:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.649996:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791104 00000100:00100000:1.0:1781281096.650044:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16581 00000100:00100000:1.0:1781281096.650050:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c6e68e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791104:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.650079:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.650156:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.650211:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c6e68e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791104:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 161us (602us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.650218:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16581 00000100:00100000:0.0:1781281096.652861:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.652958:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791168 00000100:00100000:3.0:1781281096.653012:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16582 00000100:00100000:3.0:1781281096.653019:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005d79d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791168:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.653071:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.653157:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.653224:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005d79d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791168:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 205us (369us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.653232:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16582 00000100:00100000:0.0:1781281096.660064:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.663072:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791232 00000100:00100000:0.0:1781281096.664330:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16583 00000100:00100000:0.0:1781281096.664340:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a52d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791232:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.664376:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.664473:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:0.0:1781281096.664603:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a52d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791232:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 263us (4548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.664611:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16583 00000100:00100000:1.0:1781281096.667384:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.667480:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791296 00000100:00100000:3.0:1781281096.667578:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16584 00000100:00100000:3.0:1781281096.667584:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002798b11a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791296:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.667616:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.667710:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.667762:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002798b11a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791296:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (386us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.667769:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16584 00000100:00100000:1.0:1781281096.670413:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.670729:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791360 00000100:00100000:0.0:1781281096.670795:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16585 00000100:00100000:0.0:1781281096.670803:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f52a02e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791360:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.670842:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.670948:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.671002:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f52a02e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791360:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (596us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.671009:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16585 00000100:00100000:1.0:1781281096.674521:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.679303:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791424 00000100:00100000:3.0:1781281096.679375:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16586 00000100:00100000:3.0:1781281096.679381:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6a15290 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791424:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.679414:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.679697:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.679765:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6a15290 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791424:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 382us (5252us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.681340:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16586 00000100:00100000:1.0:1781281096.684882:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.685884:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791488 00000100:00100000:3.0:1781281096.685979:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16587 00000100:00100000:3.0:1781281096.685986:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036340ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791488:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.686017:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.686100:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.686164:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036340ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791488:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (1291us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.686242:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16587 00000100:00100000:1.0:1781281096.687741:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.687865:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791616 00000100:00100000:2.0:1781281096.687917:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4826 00000100:00100000:2.0:1781281096.687924:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12565:x1867808064791616:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:2.0:1781281096.688167:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064791616:12345-192.168.202.40@tcp:35:rm.0 Request processed in 242us (431us total) trans 4294975693 rc 0/0 00000100:00100000:2.0:1781281096.688188:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4826 00000100:00100000:1.0:1781281096.691648:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.691739:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791744 00000100:00100000:0.0:1781281096.691807:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16588 00000100:00100000:0.0:1781281096.691812:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c490bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+504:12565:x1867808064791744:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.691869:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281096.691895:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c23b3b2e/0xce40b48e7ccff0b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfefd5 expref: 504 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.691920:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d10869/0xce40b48e7ccfecc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee85 expref: 503 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.691931:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e1a0892/0xce40b48e7ccfedfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1dd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfeefc expref: 502 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.691941:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7ccfecac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1dd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee7e expref: 501 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.691949:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dd:0x0].0x0 (00000000f860c354) 00010000:00010000:0.0:1781281096.691957:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.691990:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692003:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692012:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692023:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692029:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692034:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692138:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692146:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692153:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.692533:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].447, 64 off36800 00000004:00080000:0.0:1781281096.692591:0:8297:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 619397048759ns, next at 620396994803ns, rc = 0 00000040:00080000:0.0:1781281096.692615:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5076, 176 off891800 00010000:00010000:0.0:1781281096.692685:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692697:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692707:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692715:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692722:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692728:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692756:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281096.692779:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c490bad9 reply state 000000003336c9d5 transno 4294975694 ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692836:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692844:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692851:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692857:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.692861:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692867:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692878:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (00000000ffb54c4a) 00010000:00010000:0.0:1781281096.692881:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.692884:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.692889:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd2236d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.692904:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c490bad9 reply state 000000003336c9d5 transno 4294975694 ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.692989:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c490bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12565:x1867808064791744:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1174us (1349us total) trans 4294975694 rc 0/0 00000100:00100000:0.0:1781281096.692999:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16588 00010000:00010000:2.0:1781281096.693221:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281096.693227:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.693235:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc851d66 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281096.693237:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.693244:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.693253:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dd:0x0].0x0 (000000009f6df0e4) 00010000:00010000:2.0:1781281096.693255:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281096.693257:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.693263:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22382 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.693278:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281096.693279:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281096.693280:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281096.697476:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.697611:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791808 00000100:00100000:3.0:1781281096.697661:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16589 00000100:00100000:3.0:1781281096.697668:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000323ceb23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12568:x1867808064791808:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.697723:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.697822:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.697877:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000323ceb23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12568:x1867808064791808:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.697886:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16589 00010000:00010000:0.0:1781281096.701436:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.701461:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x3db54834 (00000000bde54e29) 00010000:00010000:0.0:1781281096.701464:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.701470:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.701476:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dd:0x0].0x0 (000000009f6df0e4) 00010000:00010000:0.0:1781281096.701478:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1781281096.702851:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.702954:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791872 00000100:00100000:0.0:1781281096.703011:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16590 00000100:00100000:0.0:1781281096.703017:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e707d7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12568:x1867808064791872:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.703073:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.703189:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.703249:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e707d7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12568:x1867808064791872:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 230us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.703257:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16590 00000100:00100000:1.0:1781281096.707952:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.707997:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.708070:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064791936 00000100:00100000:0.0:1781281096.708128:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792064 00000100:00100000:0.0:1781281096.708160:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16591 00000100:00100000:0.0:1781281096.708166:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42ad109 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791936:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.708208:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.708294:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.708345:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42ad109 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+503:12568:x1867808064791936:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.708353:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16591 00000100:00100000:0.0:1781281096.708372:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16592 00000100:00100000:0.0:1781281096.708377:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a822218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+502:12565:x1867808064792064:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.708412:0:6158:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281096.708438:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008910d253/0xce40b48e7ccff27f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1df:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff068 expref: 502 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708457:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f5e591c5/0xce40b48e7ccfef45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef5e expref: 501 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708469:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed627724/0xce40b48e7ccff294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff06f expref: 500 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708479:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dfba4e09/0xce40b48e7ccfef37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef57 expref: 499 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708503:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1df:0x0].0x0 (000000004a951c23) 00010000:00010000:0.0:1781281096.708521:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e89f48a6/0xce40b48e7cd02ed1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c007d7 expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708529:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x0 (000000002ad3475c) 00010000:00010000:0.0:1781281096.708532:0:6158:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.708593:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708613:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708623:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708638:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708645:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708651:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708891:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708899:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.708906:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.709263:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].449, 64 off37056 00000040:00080000:0.0:1781281096.709284:0:6158:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5077, 184 off891984 00010000:00010000:0.0:1781281096.709340:0:6158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709349:0:6158:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709358:0:6158:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709366:0:6158:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709372:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709378:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709393:0:6158:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281096.709410:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009a822218 reply state 0000000075ce36b3 transno 4294975695 ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709448:0:6158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709454:0:6158:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709461:0:6158:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709467:0:6158:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.709470:0:6158:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709481:0:6158:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709507:0:6158:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x0 (000000002ad3475c) 00010000:00010000:0.0:1781281096.709510:0:6158:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.709514:0:6158:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.709520:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd22389 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.709531:0:6158:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009a822218 reply state 0000000075ce36b3 transno 4294975695 ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.709629:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a822218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12565:x1867808064792064:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1249us (1631us total) trans 4294975695 rc 0/0 00000100:00100000:0.0:1781281096.709638:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16592 00010000:00010000:3.0:1781281096.709736:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281096.709741:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.709749:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc851d66 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281096.709752:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.709759:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.709768:0:6144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1df:0x0].0x0 (00000000f12ce057) 00010000:00010000:3.0:1781281096.709770:0:6144:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1781281096.709773:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.709778:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd2239e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639436635787712 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281096.709792:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281096.709793:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281096.709794:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281096.713301:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.713397:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792128 00000100:00100000:2.0:1781281096.713450:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16593 00000100:00100000:2.0:1781281096.713456:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009fd7c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792128:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.713497:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.713611:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:2.0:1781281096.713662:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009fd7c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792128:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 206us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.713669:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16593 00000100:00100000:2.0:1781281096.716834:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.717093:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792192 00000100:00100000:1.0:1781281096.717150:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16594 00000100:00100000:1.0:1781281096.717159:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d8d5809 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792192:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.717226:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.717315:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:1.0:1781281096.717383:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d8d5809 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792192:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 225us (557us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.717392:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16594 00000100:00100000:3.0:1781281096.720747:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.720881:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792256 00000100:00100000:2.0:1781281096.720955:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16595 00000100:00100000:2.0:1781281096.720962:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792256:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.720998:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.721100:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.721168:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6bd106e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12568:x1867808064792256:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 205us (429us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.721307:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16595 00010000:00010000:1.0:1781281096.722044:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.722061:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0xa375d043 (00000000ffb54c4a) 00010000:00010000:1.0:1781281096.722064:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281096.722069:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.722075:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1df:0x0].0x0 (00000000f12ce057) 00010000:00010000:1.0:1781281096.722077:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1781281096.724502:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.727376:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.728031:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792320 00000100:00100000:0.0:1781281096.728088:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792448 00000100:00100000:0.0:1781281096.728130:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16596 00000100:00100000:0.0:1781281096.728137:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f62f9c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12568:x1867808064792320:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.728183:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.728277:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.728339:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f62f9c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+500:12568:x1867808064792320:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 201us (3861us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.728347:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16596 00000100:00100000:0.0:1781281096.728365:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16597 00000100:00100000:0.0:1781281096.728370:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53ff83e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+499:12565:x1867808064792448:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.728405:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1781281096.728432:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d99f1204/0xce40b48e7ccff2b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e0:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff076 expref: 499 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.728451:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd1c959/0xce40b48e7ccfefa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef7a expref: 498 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.728464:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008192914f/0xce40b48e7ccff2c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff07d expref: 497 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.728475:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005e75de4b/0xce40b48e7ccfef92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef73 expref: 496 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729091:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e0:0x0].0x0 (00000000578a6873) 00010000:00010000:0.0:1781281096.729105:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.729136:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729151:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729162:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729178:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729184:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729191:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729270:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729277:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.729283:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.729909:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].448, 64 off36864 00000040:00080000:0.0:1781281096.729931:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5078, 184 off892168 00010000:00010000:0.0:1781281096.729994:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730007:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730015:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730023:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730029:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730040:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730181:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281096.730204:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e53ff83e reply state 00000000cbc641ea transno 4294975696 ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730252:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730259:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730266:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730272:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.730275:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730282:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730294:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x0 (000000002ad3475c) 00010000:00010000:0.0:1781281096.730297:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.730300:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.730306:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf09fd50/0xce40b48e7cd223a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.730315:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e53ff83e reply state 00000000cbc641ea transno 4294975696 ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.730396:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53ff83e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12565:x1867808064792448:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2023us (3026us total) trans 4294975696 rc 0/0 00000100:00100000:0.0:1781281096.730406:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16597 00010000:00010000:1.0:1781281096.737050:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281096.737065:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.737082:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000be60af33 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281096.737086:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.737096:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.737117:0:14245:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e0:0x0].0x0 (0000000096f4694f) 00010000:00010000:1.0:1781281096.737120:0:14245:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1781281096.737124:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.737130:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281096.737506:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.737609:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.737989:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792640 00000100:00100000:2.0:1781281096.738033:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16598 00000100:00100000:2.0:1781281096.738040:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090696628 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12568:x1867808064792640:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.738098:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.738196:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:2.0:1781281096.738246:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090696628 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12568:x1867808064792640:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 205us (637us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.738254:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16598 00010000:00010000:1.0:1781281096.738448:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.738461:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x820cea43 (0000000083d40933) 00010000:00010000:1.0:1781281096.738464:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281096.738467:0:3161:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281096.738473:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e0:0x0].0x0 (0000000096f4694f) 00010000:00010000:1.0:1781281096.738475:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1781281096.738519:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792576 00000100:00100000:1.0:1781281096.738569:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4827 00000100:00100000:1.0:1781281096.738573:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cfebd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12565:x1867808064792576:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:1.0:1781281096.738756:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cfebd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12565:x1867808064792576:12345-192.168.202.40@tcp:35:rm.0 Request processed in 181us (1270us total) trans 4294975697 rc 0/0 00000100:00100000:1.0:1781281096.738763:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4827 00010000:00010000:0.0:1781281096.740945:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281096.740953:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281096.740956:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281096.743113:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.743207:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792768 00000100:00100000:0.0:1781281096.743262:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16599 00000100:00100000:0.0:1781281096.743269:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b43932bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+498:12565:x1867808064792768:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1781281096.743330:0:8297:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1781281096.743360:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096781de0/0xce40b48e7cd02f80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e1:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0081d expref: 498 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743381:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e1495ad0/0xce40b48e7ccff0cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e1:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfefdc expref: 497 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743393:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad90e4dd/0xce40b48e7ccfeffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef96 expref: 496 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743404:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1682536/0xce40b48e7cd02f5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0080f expref: 495 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743414:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f47f76ae/0xce40b48e7ccfefed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef8f expref: 494 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743428:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e1:0x0].0x0 (0000000030fc2de6) 00010000:00010000:0.0:1781281096.743437:0:8297:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281096.743466:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743480:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743502:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743517:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743524:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743530:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743663:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743672:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.743679:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1781281096.744244:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].450, 64 off37120 00000040:00080000:0.0:1781281096.744264:0:8297:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].5079, 192 off892360 00010000:00010000:0.0:1781281096.744325:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744335:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744343:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744351:0:8297:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744358:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744364:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744390:0:8297:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1781281096.744408:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b43932bf reply state 000000008db38875 transno 4294975698 ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744687:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281096.744692:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744700:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a234b52 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281096.744703:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744711:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744722:0:6145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e1:0x0].0x0 (00000000c68e3776) 00010000:00010000:2.0:1781281096.744724:0:6145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1781281096.744728:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744733:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446639437592420800 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.744745:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281096.744747:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281096.744748:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281096.744852:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744860:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744869:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744874:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d25f62a6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.744877:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744882:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744890:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x0 (000000002ad3475c) 00010000:00010000:0.0:1781281096.744893:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.744895:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.744900:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d25f62a6/0xce40b48e7cd223c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1de:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1781281096.744909:0:8297:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b43932bf reply state 000000008db38875 transno 4294975698 ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281096.745029:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b43932bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+495:12565:x1867808064792768:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1758us (1922us total) trans 4294975698 rc 0/0 00000100:00100000:0.0:1781281096.745039:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16599 00000100:00100000:3.0:1781281096.748939:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.750396:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792832 00000100:00100000:0.0:1781281096.750445:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16600 00000100:00100000:0.0:1781281096.750451:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc9b797 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+495:12568:x1867808064792832:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.750504:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.750616:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00010000:00010000:2.0:1781281096.750723:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.750737:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x6fca4125 (000000009977072d) 00010000:00010000:2.0:1781281096.750740:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1781281096.750745:0:3162:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281096.750752:0:3162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e1:0x0].0x0 (00000000c68e3776) 00010000:00010000:2.0:1781281096.750755:0:3162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1781281096.755826:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc9b797 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+495:12568:x1867808064792832:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 5364us (6884us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.755842:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16600 00000100:00100000:1.0:1781281096.758985:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.759071:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.759894:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792896 00000100:00100000:0.0:1781281096.759948:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064792960 00000100:00100000:0.0:1781281096.759978:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16601 00000100:00100000:0.0:1781281096.759984:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7e1e4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12429:x1867808064792896:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1781281096.760011:0:8297:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1781281096.760032:0:8297:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092624ffc/0xce40b48e7cd223dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a89f expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760094:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760110:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760122:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760135:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760143:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760148:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760426:0:8297:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760435:0:8297:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.760442:0:8297:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1781281096.760481:0:8297:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1db:0x0]: returning size 11264 00000100:00100000:3.0:1781281096.760654:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16602 00000100:00100000:3.0:1781281096.760660:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ec900ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12568:x1867808064792960:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.760678:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.760731:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.760801:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ec900ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+497:12568:x1867808064792960:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 141us (1731us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.760810:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16602 00000004:00200000:0.0:1781281096.761064:0:8297:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00000004:00010000:0.0:1781281096.761099:0:8297:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761111:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761118:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761125:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761131:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000011eb364e already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.761134:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761141:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761158:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000f6270bb3) 00010000:00010000:0.0:1781281096.761161:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.761228:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761236:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000011eb364e/0xce40b48e7cd223e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761249:0:8297:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761255:0:8297:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761260:0:8297:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761264:0:8297:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a234b52 already unused, calling callback (00000000bff7e25e) 00010000:00010000:0.0:1781281096.761266:0:8297:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761271:0:8297:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761279:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5c7b510 (00000000dbeee980) 00010000:00010000:0.0:1781281096.761281:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1781281096.761283:0:8297:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761293:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a234b52/0xce40b48e7cd223eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761325:0:8297:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092624ffc/0xce40b48e7cd223dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a89f expref: 497 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761338:0:8297:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000be60af33/0xce40b48e7cd223f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a89f expref: 496 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281096.761344:0:8297:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x0 (0000000024b7a74e) 00010000:00010000:0.0:1781281096.761346:0:8297:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1781281096.761348:0:8297:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000be60af33, rc 0) 00000100:00100000:0.0:1781281096.761419:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7e1e4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12429:x1867808064792896:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1434us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281096.761427:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16601 00000100:00100000:3.0:1781281096.770425:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.770674:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793024 00000100:00100000:2.0:1781281096.770732:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16603 00000100:00100000:2.0:1781281096.770739:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091f3bea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793024:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.770784:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.770873:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.770938:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091f3bea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793024:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (521us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.770946:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16603 00000100:00100000:3.0:1781281096.776084:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.776195:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793088 00000100:00100000:0.0:1781281096.776252:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16604 00000100:00100000:0.0:1781281096.776259:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000477367a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793088:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.776308:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.776392:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:0.0:1781281096.776449:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000477367a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793088:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.776457:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16604 00000100:00100000:3.0:1781281096.778999:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.779083:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793152 00000100:00100000:2.0:1781281096.779138:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16605 00000100:00100000:2.0:1781281096.779145:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4000542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793152:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.779185:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.779267:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:2.0:1781281096.779324:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4000542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793152:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.779332:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16605 00000100:00100000:1.0:1781281096.781905:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.782178:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793216 00000100:00100000:0.0:1781281096.782226:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16606 00000100:00100000:0.0:1781281096.782232:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010c26317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793216:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.782262:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.782354:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.782414:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010c26317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793216:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 181us (515us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.782423:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16606 00010000:00010000:3.0:1781281096.784789:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281096.787333:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.787412:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793280 00000100:00100000:2.0:1781281096.787469:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16607 00000100:00100000:2.0:1781281096.787477:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002fe2068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793280:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.787533:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.787661:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.787711:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002fe2068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793280:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 233us (384us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.787719:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16607 00000100:00100000:3.0:1781281096.792338:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.792423:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793344 00000100:00100000:0.0:1781281096.792474:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16608 00000100:00100000:0.0:1781281096.792480:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e07c0d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793344:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.792531:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.792655:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.792714:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e07c0d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793344:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 233us (383us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.792722:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16608 00000100:00100000:1.0:1781281096.796725:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.796868:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793408 00000100:00100000:2.0:1781281096.796923:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16609 00000100:00100000:2.0:1781281096.796930:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000370e3267 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793408:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.796987:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.797081:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.797141:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000370e3267 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793408:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 211us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.797149:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16609 00000100:00100000:3.0:1781281096.800662:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.801072:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793472 00000100:00100000:0.0:1781281096.801129:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16610 00000100:00100000:0.0:1781281096.801135:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000338c87f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793472:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.801168:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.801263:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:0.0:1781281096.801327:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000338c87f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793472:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 192us (674us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.801334:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16610 00000100:00100000:3.0:1781281096.804355:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.804918:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793536 00000100:00100000:2.0:1781281096.804997:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16611 00000100:00100000:2.0:1781281096.805004:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f90863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793536:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.805034:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.805115:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:2.0:1781281096.805230:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f90863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793536:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 225us (881us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.805238:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16611 00000100:00100000:1.0:1781281096.807441:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.808511:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793600 00000100:00100000:0.0:1781281096.808595:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16612 00000100:00100000:0.0:1781281096.808602:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022d0dabc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793600:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.808657:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.808757:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.808826:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022d0dabc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793600:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 223us (1393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.808835:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16612 00000100:00100000:0.0:1781281096.812313:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.812406:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793664 00000100:00100000:3.0:1781281096.812479:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16613 00000100:00100000:3.0:1781281096.812506:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099a73f19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793664:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.812569:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.812656:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.812715:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099a73f19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793664:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 220us (409us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.812723:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16613 00000100:00100000:1.0:1781281096.815903:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.816950:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793728 00000100:00100000:3.0:1781281096.817043:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16614 00000100:00100000:3.0:1781281096.817051:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e81add84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793728:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.817084:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.817184:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.817239:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e81add84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793728:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 186us (1343us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.817246:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16614 00000100:00100000:1.0:1781281096.819765:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.819910:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793792 00000100:00100000:0.0:1781281096.819960:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16615 00000100:00100000:0.0:1781281096.819967:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793792:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.820000:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.820091:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20d:0x0]: rc = -2 00000100:00100000:0.0:1781281096.820148:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df460404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793792:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 180us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.820156:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16615 00000100:00100000:0.0:1781281096.822384:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.822698:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793856 00000100:00100000:1.0:1781281096.822786:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16616 00000100:00100000:1.0:1781281096.822793:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096d1457a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793856:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.822828:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.822921:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.822972:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096d1457a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793856:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (595us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.822979:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16616 00000100:00100000:1.0:1781281096.825109:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.825157:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793920 00000100:00100000:1.0:1781281096.825217:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16617 00000100:00100000:1.0:1781281096.825224:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793920:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.825253:0:8297:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.825338:0:8297:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.825392:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087552764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793920:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 168us (291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.825400:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16617 00000100:00100000:2.0:1781281096.829418:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.829531:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064793984 00000100:00100000:0.0:1781281096.829623:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16618 00000100:00100000:0.0:1781281096.829630:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000340d2dfb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793984:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.829662:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.829751:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.829821:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000340d2dfb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064793984:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (410us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.829830:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16618 00000100:00100000:2.0:1781281096.832461:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.832645:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794048 00000100:00100000:3.0:1781281096.832703:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16619 00000100:00100000:3.0:1781281096.832710:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003146bcc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794048:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.832766:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.832867:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.833132:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003146bcc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794048:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 421us (677us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.833140:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16619 00000100:00100000:2.0:1781281096.835969:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.836454:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794112 00000100:00100000:3.0:1781281096.836683:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16620 00000100:00100000:3.0:1781281096.836690:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff913eec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794112:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.836723:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.836823:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.836885:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff913eec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794112:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (922us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.836892:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16620 00000100:00100000:0.0:1781281096.839230:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.839425:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794176 00000100:00100000:1.0:1781281096.839475:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16621 00000100:00100000:1.0:1781281096.839492:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000556ce00d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794176:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.839532:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.839637:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:1.0:1781281096.839693:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000556ce00d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794176:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 211us (470us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.839701:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16621 00000100:00100000:2.0:1781281096.842227:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.842469:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794240 00000100:00100000:0.0:1781281096.842583:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16622 00000100:00100000:0.0:1781281096.842591:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2284ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794240:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.842623:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.842717:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:0.0:1781281096.842779:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2284ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794240:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.842788:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16622 00000100:00100000:0.0:1781281096.845738:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.845862:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794304 00000100:00100000:1.0:1781281096.845917:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16623 00000100:00100000:1.0:1781281096.845924:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053b277dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794304:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.845977:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.846062:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:1.0:1781281096.846119:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053b277dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794304:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (388us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.846127:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16623 00000100:00100000:0.0:1781281096.849355:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.849671:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794368 00000100:00100000:3.0:1781281096.849718:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16624 00000100:00100000:3.0:1781281096.849725:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9a65af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794368:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.849756:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.849861:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.849921:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9a65af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794368:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.849929:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16624 00000100:00100000:2.0:1781281096.853383:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.853470:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794432 00000100:00100000:0.0:1781281096.853940:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16625 00000100:00100000:0.0:1781281096.853948:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0fc9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794432:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.854005:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.854095:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:0.0:1781281096.854157:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0fc9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794432:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (781us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.854165:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16625 00000100:00100000:1.0:1781281096.856639:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.859265:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794496 00000100:00100000:2.0:1781281096.859340:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16626 00000100:00100000:2.0:1781281096.859346:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000906a8ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794496:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.859377:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.859473:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:2.0:1781281096.859915:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000906a8ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794496:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 565us (3279us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.859923:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16626 00000100:00100000:0.0:1781281096.862477:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.862861:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794560 00000100:00100000:3.0:1781281096.862945:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16627 00000100:00100000:3.0:1781281096.862952:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794560:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.862987:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.863074:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.863133:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e28bbf4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794560:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (665us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.863141:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16627 00000100:00100000:0.0:1781281096.865842:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.865927:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794624 00000100:00100000:2.0:1781281096.865983:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16628 00000100:00100000:2.0:1781281096.865990:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794624:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.866021:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.866110:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.866160:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064be7b70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794624:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 169us (325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.866169:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16628 00000100:00100000:1.0:1781281096.869630:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.869891:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794688 00000100:00100000:3.0:1781281096.869945:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16629 00000100:00100000:3.0:1781281096.869951:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b903037c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794688:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.870013:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.870104:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.870166:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b903037c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794688:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 214us (545us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.870183:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16629 00000100:00100000:0.0:1781281096.873291:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.873378:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794752 00000100:00100000:2.0:1781281096.873431:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16630 00000100:00100000:2.0:1781281096.873437:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794752:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.873510:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.873631:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:2.0:1781281096.873690:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ad3208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794752:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 251us (406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.873698:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16630 00000100:00100000:2.0:1781281096.883307:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.883405:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794816 00000100:00100000:3.0:1781281096.883461:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16631 00000100:00100000:3.0:1781281096.883467:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000810f51a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794816:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.883516:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x232:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.883636:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x232:0x0]: rc = -2 00000100:00100000:3.0:1781281096.883683:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000810f51a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794816:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 215us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.883691:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16631 00000100:00100000:1.0:1781281096.886894:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.887010:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794880 00000100:00100000:2.0:1781281096.887065:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16632 00000100:00100000:2.0:1781281096.887072:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d63c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794880:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.887104:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.887198:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:2.0:1781281096.887264:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d63c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794880:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 191us (377us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.887272:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16632 00000100:00100000:0.0:1781281096.891653:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.891757:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064794944 00000100:00100000:3.0:1781281096.891814:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16633 00000100:00100000:3.0:1781281096.891821:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018fe6ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794944:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.891864:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.891947:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.891996:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018fe6ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064794944:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 175us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.892005:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16633 00000100:00100000:0.0:1781281096.895863:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.895968:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795008 00000100:00100000:2.0:1781281096.896023:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16634 00000100:00100000:2.0:1781281096.896030:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c15430a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795008:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.896072:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.896163:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:2.0:1781281096.896226:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c15430a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795008:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (371us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.896235:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16634 00000100:00100000:2.0:1781281096.901073:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.901165:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795072 00000100:00100000:3.0:1781281096.901226:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16635 00000100:00100000:3.0:1781281096.901233:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4122340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795072:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.901263:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.901347:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.901407:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4122340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795072:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 174us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.901415:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16635 00000100:00100000:0.0:1781281096.904520:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.904647:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795136 00000100:00100000:2.0:1781281096.904706:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16636 00000100:00100000:2.0:1781281096.904714:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007879add7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795136:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.904749:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.904861:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:2.0:1781281096.904922:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007879add7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795136:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 207us (409us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.904930:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16636 00000100:00100000:0.0:1781281096.909849:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.910292:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795200 00000100:00100000:3.0:1781281096.910387:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16637 00000100:00100000:3.0:1781281096.910394:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795200:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.910448:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.910587:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.910646:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041cd4f05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795200:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 252us (814us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.910654:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16637 00000100:00100000:0.0:1781281096.913434:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.914480:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795264 00000100:00100000:2.0:1781281096.914572:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16638 00000100:00100000:2.0:1781281096.914579:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795264:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.914636:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x25d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.914728:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x25d:0x0]: rc = -2 00000100:00100000:2.0:1781281096.914798:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e667aa3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795264:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 218us (1369us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.914806:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16638 00000100:00100000:2.0:1781281096.918440:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.918526:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795328 00000100:00100000:3.0:1781281096.918699:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16639 00000100:00100000:3.0:1781281096.918706:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002479984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795328:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.918738:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x25d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.918998:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x25d:0x0]: rc = -2 00000100:00100000:3.0:1781281096.919059:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002479984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795328:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 351us (627us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.919646:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16639 00000100:00100000:2.0:1781281096.922638:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.922989:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795392 00000100:00100000:0.0:1781281096.923041:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16640 00000100:00100000:0.0:1781281096.923048:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a122651 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795392:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.923095:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.923180:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:0.0:1781281096.923237:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a122651 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795392:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (605us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.923245:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16640 00000100:00100000:1.0:1781281096.927742:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.928404:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795456 00000100:00100000:3.0:1781281096.928459:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16641 00000100:00100000:3.0:1781281096.928466:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f484cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795456:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.928625:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.928717:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.928955:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f484cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795456:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 488us (1420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.928965:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16641 00000100:00100000:2.0:1781281096.933405:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.933537:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795520 00000100:00100000:3.0:1781281096.933622:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16642 00000100:00100000:3.0:1781281096.933629:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0d4f52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795520:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.933663:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.933764:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:3.0:1781281096.933823:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0d4f52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795520:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (426us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.933836:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16642 00000100:00100000:0.0:1781281096.938296:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.938419:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795584 00000100:00100000:2.0:1781281096.938522:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16643 00000100:00100000:2.0:1781281096.938528:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795584:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.938636:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x200:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.938724:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x200:0x0]: rc = -2 00000100:00100000:2.0:1781281096.938793:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e36f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795584:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 263us (505us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.938802:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16643 00000100:00100000:0.0:1781281096.941922:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.942422:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795648 00000100:00100000:3.0:1781281096.942465:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16644 00000100:00100000:3.0:1781281096.942472:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fce62496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795648:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.942536:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.942655:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:3.0:1781281096.942721:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fce62496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795648:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 249us (807us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.942729:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16644 00000100:00100000:3.0:1781281096.946191:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.946323:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795712 00000100:00100000:1.0:1781281096.946373:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16645 00000100:00100000:1.0:1781281096.946379:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a757009e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795712:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.946409:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.946507:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281096.947224:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a757009e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795712:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 841us (1036us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.947234:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16645 00000100:00100000:0.0:1781281096.950513:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.951220:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795776 00000100:00100000:2.0:1781281096.951264:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16646 00000100:00100000:2.0:1781281096.951270:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2994d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795776:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.951302:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.951391:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:2.0:1781281096.951447:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2994d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795776:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 176us (951us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.951455:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16646 00000100:00100000:0.0:1781281096.955440:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.955746:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795840 00000100:00100000:2.0:1781281096.955903:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16647 00000100:00100000:2.0:1781281096.955909:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e868e8a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795840:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.955939:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.956029:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:2.0:1781281096.956100:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e868e8a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795840:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (667us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.956107:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16647 00000100:00100000:3.0:1781281096.960832:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281096.960971:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795904 00000100:00100000:2.0:1781281096.961072:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16648 00000100:00100000:2.0:1781281096.961079:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795904:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281096.961133:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281096.961353:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:2.0:1781281096.961416:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9611f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795904:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 336us (650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281096.961425:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16648 00000100:00100000:1.0:1781281096.964463:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.964966:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064795968 00000100:00100000:0.0:1781281096.965027:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16649 00000100:00100000:0.0:1781281096.965034:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795968:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.965075:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.965164:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:0.0:1781281096.965401:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062a02db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064795968:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 366us (945us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.965410:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16649 00000100:00100000:1.0:1781281096.967754:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.967871:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796032 00000100:00100000:0.0:1781281096.967914:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16650 00000100:00100000:0.0:1781281096.967920:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d530678 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796032:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.967948:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.968033:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281096.968100:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d530678 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796032:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (354us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.968108:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16650 00000100:00100000:1.0:1781281096.971370:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.971472:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796096 00000100:00100000:0.0:1781281096.971566:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16651 00000100:00100000:0.0:1781281096.971574:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e3d67b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796096:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.971629:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.971722:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281096.971784:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e3d67b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796096:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.971792:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16651 00000100:00100000:0.0:1781281096.974623:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.975333:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796160 00000100:00100000:1.0:1781281096.975387:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16652 00000100:00100000:1.0:1781281096.975393:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae80e5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796160:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.975423:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.975516:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:1.0:1781281096.975595:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae80e5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796160:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 201us (979us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.975603:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16652 00000100:00100000:0.0:1781281096.978875:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.978963:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796224 00000100:00100000:3.0:1781281096.979033:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16653 00000100:00100000:3.0:1781281096.979040:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f7d2e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796224:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.979079:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.979157:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:3.0:1781281096.979222:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f7d2e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796224:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 182us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.979229:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16653 00000100:00100000:2.0:1781281096.981878:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.982577:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796288 00000100:00100000:0.0:1781281096.982634:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16654 00000100:00100000:0.0:1781281096.982640:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e535869 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796288:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.982672:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.982763:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:0.0:1781281096.983027:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e535869 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796288:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 385us (1156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.983036:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16654 00000100:00100000:2.0:1781281096.985906:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281096.985983:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796352 00000100:00100000:3.0:1781281096.986029:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16655 00000100:00100000:3.0:1781281096.986036:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000615ec052 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796352:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281096.986067:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x263:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281096.986150:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x263:0x0]: rc = -2 00000100:00100000:3.0:1781281096.986213:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000615ec052 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796352:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 176us (314us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281096.986221:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16655 00000100:00100000:2.0:1781281096.988861:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281096.989005:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796416 00000100:00100000:0.0:1781281096.989055:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16656 00000100:00100000:0.0:1781281096.989061:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0ab6be7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796416:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281096.989091:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.989192:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281096.989250:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0ab6be7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796416:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 187us (395us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.989258:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16656 00000100:00100000:2.0:1781281096.992279:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.992371:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796480 00000100:00100000:1.0:1781281096.992456:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16657 00000100:00100000:1.0:1781281096.992463:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2558389 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796480:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.992510:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281096.992614:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1781281096.992665:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2558389 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796480:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 202us (394us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281096.992673:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16657 00000100:00100000:3.0:1781281096.995447:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281096.997371:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796544 00000100:00100000:1.0:1781281096.997436:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16658 00000100:00100000:1.0:1781281096.997443:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000985213de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796544:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281096.997517:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281096.997968:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281096.998064:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000985213de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796544:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 620us (2624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281096.998074:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16658 00000100:00100000:2.0:1781281097.001517:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.001675:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796608 00000100:00100000:0.0:1781281097.001723:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16659 00000100:00100000:0.0:1781281097.001729:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000750ce63f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796608:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.001761:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.001857:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.001907:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000750ce63f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796608:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 176us (399us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.001914:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16659 00000100:00100000:1.0:1781281097.004605:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.004724:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796672 00000100:00100000:3.0:1781281097.004779:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16660 00000100:00100000:3.0:1781281097.004785:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796672:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.004820:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.004909:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:3.0:1781281097.004960:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552bb12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796672:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 174us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.004968:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16660 00000100:00100000:2.0:1781281097.008270:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.008356:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796736 00000100:00100000:0.0:1781281097.008406:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16661 00000100:00100000:0.0:1781281097.008412:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bca97f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796736:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.008464:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.008604:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.008649:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bca97f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796736:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 236us (386us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.008657:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16661 00000100:00100000:2.0:1781281097.010986:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.011064:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796800 00000100:00100000:3.0:1781281097.011109:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16662 00000100:00100000:3.0:1781281097.011114:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000886356f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796800:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.011159:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.011255:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:3.0:1781281097.011308:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000886356f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796800:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 193us (331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.011316:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16662 00000100:00100000:1.0:1781281097.014428:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.014530:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796864 00000100:00100000:0.0:1781281097.014615:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16663 00000100:00100000:0.0:1781281097.014622:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f85244d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796864:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.014651:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.014733:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:0.0:1781281097.014849:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f85244d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796864:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 226us (427us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.014857:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16663 00000100:00100000:2.0:1781281097.020521:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.020706:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796928 00000100:00100000:3.0:1781281097.020757:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16664 00000100:00100000:3.0:1781281097.020763:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b60ab07d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796928:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.020801:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.020892:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:3.0:1781281097.020950:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b60ab07d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796928:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 187us (436us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.020959:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16664 00000100:00100000:2.0:1781281097.024322:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.024988:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064796992 00000100:00100000:0.0:1781281097.025075:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16665 00000100:00100000:0.0:1781281097.025091:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a00ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796992:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.025126:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.025227:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.025287:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a00ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064796992:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 204us (971us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.025295:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16665 00000100:00100000:1.0:1781281097.027429:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.028440:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797056 00000100:00100000:3.0:1781281097.028514:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16666 00000100:00100000:3.0:1781281097.028521:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007de72e08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797056:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.028566:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.028648:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:3.0:1781281097.028706:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007de72e08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797056:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 185us (1284us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.028714:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16666 00000100:00100000:2.0:1781281097.031454:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.031954:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797120 00000100:00100000:2.0:1781281097.032074:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16667 00000100:00100000:2.0:1781281097.032079:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c188eca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797120:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.032105:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.032199:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:2.0:1781281097.032253:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c188eca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797120:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 172us (806us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.032261:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16667 00000100:00100000:1.0:1781281097.034352:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.035268:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797184 00000100:00100000:0.0:1781281097.035332:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16668 00000100:00100000:0.0:1781281097.035339:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cf74694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797184:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.035371:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.035458:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.035535:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cf74694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797184:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (1189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.035570:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16668 00000100:00100000:0.0:1781281097.038006:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.038121:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797248 00000100:00100000:1.0:1781281097.038262:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16669 00000100:00100000:1.0:1781281097.038269:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c2ccc88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797248:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.038302:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.038385:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1781281097.038434:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c2ccc88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797248:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 164us (435us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.038881:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16669 00000100:00100000:1.0:1781281097.041973:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.042095:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797312 00000100:00100000:3.0:1781281097.042143:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16670 00000100:00100000:3.0:1781281097.042149:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029a90b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797312:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.042264:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.042345:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:3.0:1781281097.042426:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029a90b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797312:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 276us (459us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.042435:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16670 00000100:00100000:1.0:1781281097.044692:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.044787:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797376 00000100:00100000:3.0:1781281097.044834:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16671 00000100:00100000:3.0:1781281097.044840:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030731f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797376:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.044890:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x225:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.044968:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x225:0x0]: rc = -2 00000100:00100000:3.0:1781281097.045009:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030731f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797376:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 168us (323us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.045020:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16671 00000100:00100000:2.0:1781281097.047332:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.047588:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797440 00000100:00100000:1.0:1781281097.047636:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16672 00000100:00100000:1.0:1781281097.047642:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005441d199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797440:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.047671:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.047754:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1781281097.047817:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005441d199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797440:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 174us (493us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.047824:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16672 00000100:00100000:2.0:1781281097.051797:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.052936:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797504 00000100:00100000:2.0:1781281097.053099:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16673 00000100:00100000:2.0:1781281097.053107:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f78667e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797504:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.053137:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.053234:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:2.0:1781281097.053299:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f78667e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797504:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 191us (1509us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.053307:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16673 00000100:00100000:2.0:1781281097.056888:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.057021:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797568 00000100:00100000:0.0:1781281097.057074:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16674 00000100:00100000:0.0:1781281097.057083:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000add9343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797568:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.057135:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.057235:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.057300:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000add9343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797568:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 217us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.057308:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16674 00000100:00100000:3.0:1781281097.063165:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.063331:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797632 00000100:00100000:1.0:1781281097.063424:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16675 00000100:00100000:1.0:1781281097.063431:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083c709e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797632:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.063462:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.063656:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1781281097.063704:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083c709e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797632:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 272us (547us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.063713:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16675 00000100:00100000:2.0:1781281097.067299:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.067379:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797696 00000100:00100000:1.0:1781281097.067467:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16676 00000100:00100000:1.0:1781281097.067474:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000320b3177 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797696:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.067684:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1fa:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.067850:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1fa:0x0]: rc = -2 00000100:00100000:1.0:1781281097.067956:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000320b3177 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797696:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 481us (664us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.067967:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16676 00000100:00100000:2.0:1781281097.070767:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.070892:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797760 00000100:00100000:1.0:1781281097.070941:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16677 00000100:00100000:1.0:1781281097.070948:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063f803a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797760:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.070977:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1fa:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.071061:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1fa:0x0]: rc = -2 00000100:00100000:1.0:1781281097.071157:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063f803a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797760:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (396us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.071175:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16677 00000100:00100000:3.0:1781281097.074041:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.074318:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797824 00000100:00100000:0.0:1781281097.074400:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16678 00000100:00100000:0.0:1781281097.074407:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d304ab6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797824:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.074439:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.074588:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.074694:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d304ab6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797824:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 286us (660us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.074702:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16678 00000100:00100000:2.0:1781281097.077409:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.077858:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797888 00000100:00100000:0.0:1781281097.077910:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16679 00000100:00100000:0.0:1781281097.077917:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797888:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.077949:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.078045:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.078108:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001fab021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797888:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (706us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.078116:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16679 00000100:00100000:2.0:1781281097.080625:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.080730:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064797952 00000100:00100000:1.0:1781281097.080783:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16680 00000100:00100000:1.0:1781281097.080789:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001d9283c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797952:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.080820:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1fa:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.080908:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1fa:0x0]: rc = -2 00000100:00100000:1.0:1781281097.080957:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001d9283c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064797952:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 167us (340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.080965:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16680 00000100:00100000:2.0:1781281097.084384:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.084606:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798016 00000100:00100000:0.0:1781281097.084682:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16681 00000100:00100000:0.0:1781281097.084688:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017a834ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798016:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.084719:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1fa:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.084870:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1fa:0x0]: rc = -2 00000100:00100000:0.0:1781281097.084963:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017a834ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798016:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 274us (586us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.084971:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16681 00000100:00100000:2.0:1781281097.087973:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.088083:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798080 00000100:00100000:0.0:1781281097.088156:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16682 00000100:00100000:0.0:1781281097.088163:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003a1be71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798080:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.088219:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.088300:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:0.0:1781281097.088354:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003a1be71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798080:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 191us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.088363:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16682 00000100:00100000:2.0:1781281097.090694:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.090982:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798144 00000100:00100000:1.0:1781281097.091033:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16683 00000100:00100000:1.0:1781281097.091040:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c3cacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798144:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.091070:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.091149:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:1.0:1781281097.091354:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c3cacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798144:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 313us (667us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.091363:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16683 00000100:00100000:2.0:1781281097.094760:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.095000:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798208 00000100:00100000:0.0:1781281097.095080:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16684 00000100:00100000:0.0:1781281097.095087:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798208:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.095121:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.095225:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.095282:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bf46d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798208:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (532us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.095290:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16684 00000100:00100000:2.0:1781281097.099275:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.099682:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798272 00000100:00100000:1.0:1781281097.099729:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16685 00000100:00100000:1.0:1781281097.099735:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bb062e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798272:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.099905:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.099994:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.100090:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bb062e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798272:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 353us (822us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.100099:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16685 00000100:00100000:2.0:1781281097.113283:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.116719:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798336 00000100:00100000:1.0:1781281097.116792:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16686 00000100:00100000:1.0:1781281097.116798:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031b748c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798336:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.116835:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.116932:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:1.0:1781281097.117007:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031b748c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798336:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 208us (3732us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.117015:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16686 00000100:00100000:3.0:1781281097.120451:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.120537:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798400 00000100:00100000:0.0:1781281097.120615:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16687 00000100:00100000:0.0:1781281097.120622:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e22f8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798400:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.120655:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.120739:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:0.0:1781281097.120807:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e22f8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798400:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 184us (366us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.120815:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16687 00000100:00100000:3.0:1781281097.123310:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.125038:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798464 00000100:00100000:1.0:1781281097.125102:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16688 00000100:00100000:1.0:1781281097.125109:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000734b3914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798464:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.125142:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.125232:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.125291:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000734b3914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798464:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 181us (1988us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.125304:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16688 00000100:00100000:3.0:1781281097.128231:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.128318:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798528 00000100:00100000:0.0:1781281097.128367:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16689 00000100:00100000:0.0:1781281097.128373:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050e0048f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798528:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.128401:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.128525:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.128598:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050e0048f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798528:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 224us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.128606:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16689 00000100:00100000:1.0:1781281097.131197:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.131299:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798592 00000100:00100000:0.0:1781281097.131349:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16690 00000100:00100000:0.0:1781281097.131355:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003a27455 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798592:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.131404:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.131515:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:0.0:1781281097.131590:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003a27455 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798592:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 234us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.131597:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16690 00000100:00100000:1.0:1781281097.135469:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.135751:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798656 00000100:00100000:0.0:1781281097.135815:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16691 00000100:00100000:0.0:1781281097.135822:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000243be12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798656:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.135851:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x260:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.135947:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x260:0x0]: rc = -2 00000100:00100000:0.0:1781281097.135999:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000243be12d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798656:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (540us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.136008:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16691 00000100:00100000:2.0:1781281097.139129:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.139335:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798720 00000100:00100000:1.0:1781281097.139389:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16692 00000100:00100000:1.0:1781281097.139397:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0c32e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798720:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.139435:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.140135:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.140243:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0c32e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798720:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 844us (1120us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.140254:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16692 00000100:00100000:2.0:1781281097.142380:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.142458:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798784 00000100:00100000:0.0:1781281097.142523:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16693 00000100:00100000:0.0:1781281097.142530:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007734cf26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798784:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.142586:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.142673:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.142718:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007734cf26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798784:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 188us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.142727:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16693 00000100:00100000:1.0:1781281097.149157:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.149241:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798848 00000100:00100000:0.0:1781281097.149298:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16694 00000100:00100000:0.0:1781281097.149305:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e59730c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798848:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.149339:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.149435:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.149505:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e59730c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798848:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 199us (356us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.149513:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16694 00000100:00100000:2.0:1781281097.152953:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.153035:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798912 00000100:00100000:0.0:1781281097.153092:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16695 00000100:00100000:0.0:1781281097.153099:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5f69cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798912:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.153153:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.153250:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.153304:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5f69cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798912:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 205us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.153317:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16695 00000100:00100000:1.0:1781281097.155852:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.156144:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064798976 00000100:00100000:0.0:1781281097.156508:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16696 00000100:00100000:0.0:1781281097.156515:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035a4c194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798976:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.156587:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.156688:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.156741:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035a4c194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064798976:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 225us (896us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.156747:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16696 00000100:00100000:3.0:1781281097.169336:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.169427:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799040 00000100:00100000:0.0:1781281097.169493:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16697 00000100:00100000:0.0:1781281097.169508:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078b9f818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799040:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.169557:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.169646:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:0.0:1781281097.169707:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078b9f818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799040:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (378us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.169716:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16697 00000100:00100000:2.0:1781281097.172862:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.173212:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799104 00000100:00100000:0.0:1781281097.173261:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16698 00000100:00100000:0.0:1781281097.173269:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010d45d45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799104:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.173303:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.173396:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.173466:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010d45d45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799104:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 197us (612us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.173487:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16698 00000100:00100000:1.0:1781281097.176970:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.177162:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799168 00000100:00100000:0.0:1781281097.177230:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16699 00000100:00100000:0.0:1781281097.177238:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cc2f86a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799168:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.177298:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.177393:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.177453:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cc2f86a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799168:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 214us (491us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.177460:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16699 00000100:00100000:3.0:1781281097.180697:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.180792:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799232 00000100:00100000:2.0:1781281097.180843:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16700 00000100:00100000:2.0:1781281097.180850:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ceaec16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799232:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.180884:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.180970:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:2.0:1781281097.181029:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ceaec16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799232:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.181037:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16700 00000100:00100000:3.0:1781281097.183932:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.184063:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799296 00000100:00100000:1.0:1781281097.184117:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16701 00000100:00100000:1.0:1781281097.184124:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b4c77bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799296:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.184184:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.184270:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:1.0:1781281097.184332:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b4c77bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799296:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 208us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.184340:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16701 00000100:00100000:1.0:1781281097.187137:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.187220:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799360 00000100:00100000:2.0:1781281097.187271:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16702 00000100:00100000:2.0:1781281097.187277:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021a13984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799360:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.187326:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.187416:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.187472:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021a13984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799360:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (343us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.187490:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16702 00000100:00100000:3.0:1781281097.191462:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.191600:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799424 00000100:00100000:1.0:1781281097.191661:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16703 00000100:00100000:1.0:1781281097.191668:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bea495a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799424:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.191705:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.191799:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.191868:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bea495a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799424:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (415us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.191877:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16703 00000100:00100000:3.0:1781281097.194755:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.194976:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799488 00000100:00100000:2.0:1781281097.195027:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16704 00000100:00100000:2.0:1781281097.195034:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a53af6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799488:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.195065:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.195153:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:2.0:1781281097.195213:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a53af6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799488:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 179us (466us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.195221:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16704 00000100:00100000:3.0:1781281097.197880:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.198008:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799552 00000100:00100000:1.0:1781281097.198057:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16705 00000100:00100000:1.0:1781281097.198064:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799552:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.198098:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.198198:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22a:0x0]: rc = -2 00000100:00100000:1.0:1781281097.198261:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f63b7c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799552:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.198269:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16705 00000100:00100000:3.0:1781281097.202924:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.203005:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799616 00000100:00100000:2.0:1781281097.203061:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16706 00000100:00100000:2.0:1781281097.203068:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799616:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.203100:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.203201:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.203259:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000feb74d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799616:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 191us (344us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.203268:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16706 00000100:00100000:3.0:1781281097.209317:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.209404:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799680 00000100:00100000:1.0:1781281097.209458:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16707 00000100:00100000:1.0:1781281097.209465:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab39167a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799680:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.209509:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.209630:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.209687:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab39167a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799680:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 222us (378us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.209695:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16707 00000100:00100000:3.0:1781281097.212677:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.212940:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799744 00000100:00100000:2.0:1781281097.212993:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16708 00000100:00100000:2.0:1781281097.213000:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dde30e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799744:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.213032:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.213125:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.213372:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dde30e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799744:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 371us (701us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.213382:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16708 00000100:00100000:3.0:1781281097.217260:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.217347:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799808 00000100:00100000:2.0:1781281097.217406:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16709 00000100:00100000:2.0:1781281097.217413:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799808:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.217470:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.217616:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.217679:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000876fffde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799808:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 265us (426us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.217689:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16709 00000100:00100000:3.0:1781281097.220734:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.220831:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799872 00000100:00100000:1.0:1781281097.220886:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16710 00000100:00100000:1.0:1781281097.220892:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799872:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.220949:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.221038:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.221183:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fba7a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799872:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 289us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.221194:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16710 00000100:00100000:3.0:1781281097.224780:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.224882:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064799936 00000100:00100000:2.0:1781281097.224953:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16711 00000100:00100000:2.0:1781281097.224962:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799936:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.225003:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.225103:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.225163:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f179f403 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064799936:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 201us (401us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.225178:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16711 00000100:00100000:3.0:1781281097.227948:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.228228:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800000 00000100:00100000:1.0:1781281097.228283:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16712 00000100:00100000:1.0:1781281097.228290:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800000:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.228322:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.228414:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:1.0:1781281097.228476:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad8ffb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800000:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 185us (537us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.228493:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16712 00000100:00100000:3.0:1781281097.231948:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.232049:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800064 00000100:00100000:2.0:1781281097.232136:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16713 00000100:00100000:2.0:1781281097.232144:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e434bf45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800064:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.232196:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.232289:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.232389:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e434bf45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800064:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 245us (448us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.232397:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16713 00000100:00100000:3.0:1781281097.235515:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.235696:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800128 00000100:00100000:2.0:1781281097.235747:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16714 00000100:00100000:2.0:1781281097.235754:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000317757f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800128:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.235789:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.235876:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.235936:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000317757f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800128:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 182us (430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.235949:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16714 00000100:00100000:3.0:1781281097.239123:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.239214:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800192 00000100:00100000:1.0:1781281097.239269:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16715 00000100:00100000:1.0:1781281097.239276:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800192:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.239310:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.239395:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.239451:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b85a7e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800192:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 175us (335us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.239459:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16715 00000100:00100000:3.0:1781281097.242886:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.243153:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800256 00000100:00100000:2.0:1781281097.243213:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16716 00000100:00100000:2.0:1781281097.243219:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800256:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.243269:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.243364:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.243424:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019118588 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800256:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 203us (546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.243432:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16716 00000100:00100000:3.0:1781281097.247106:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.247204:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800320 00000100:00100000:1.0:1781281097.247257:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16717 00000100:00100000:1.0:1781281097.247264:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2bb90d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800320:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.247299:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.247385:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:1.0:1781281097.247442:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2bb90d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800320:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (344us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.247454:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16717 00000100:00100000:3.0:1781281097.250859:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.251118:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800384 00000100:00100000:2.0:1781281097.251171:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16718 00000100:00100000:2.0:1781281097.251179:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e977ed6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800384:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.251214:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.251308:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.251373:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e977ed6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800384:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (524us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.251380:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16718 00000100:00100000:3.0:1781281097.256494:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.256858:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800448 00000100:00100000:1.0:1781281097.256948:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16719 00000100:00100000:1.0:1781281097.256956:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b0b16e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800448:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.257007:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.257094:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:1.0:1781281097.257151:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b0b16e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800448:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (676us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.257159:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16719 00000100:00100000:3.0:1781281097.260026:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.260536:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800512 00000100:00100000:2.0:1781281097.260612:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16720 00000100:00100000:2.0:1781281097.260619:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000463a886d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800512:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.260650:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.260730:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.260793:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000463a886d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800512:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 173us (775us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.260805:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16720 00000100:00100000:3.0:1781281097.263839:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.264000:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800576 00000100:00100000:1.0:1781281097.264046:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16721 00000100:00100000:1.0:1781281097.264053:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032070cdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800576:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.264087:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.264187:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:1.0:1781281097.264244:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032070cdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800576:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (414us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.264252:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16721 00000100:00100000:1.0:1781281097.266645:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.267060:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800640 00000100:00100000:3.0:1781281097.267111:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16722 00000100:00100000:3.0:1781281097.267118:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071c698b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800640:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.267152:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.267252:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.267303:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071c698b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800640:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 185us (665us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.267312:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16722 00000100:00100000:1.0:1781281097.269864:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.269941:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800704 00000100:00100000:3.0:1781281097.269991:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16723 00000100:00100000:3.0:1781281097.269997:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800704:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.270025:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.270103:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.270150:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d98347d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800704:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 152us (294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.270158:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16723 00000100:00100000:3.0:1781281097.272160:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.272232:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800768 00000100:00100000:1.0:1781281097.272274:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16724 00000100:00100000:1.0:1781281097.272280:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e9c689f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800768:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.272307:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.272378:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:1.0:1781281097.272528:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e9c689f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800768:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 247us (373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.272536:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16724 00000100:00100000:1.0:1781281097.275450:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.275618:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800832 00000100:00100000:2.0:1781281097.275661:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16725 00000100:00100000:2.0:1781281097.275667:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bf22a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800832:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.275697:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.275788:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.275836:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bf22a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800832:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 169us (394us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.275844:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16725 00000100:00100000:1.0:1781281097.278537:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.278668:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800896 00000100:00100000:0.0:1781281097.278715:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16726 00000100:00100000:0.0:1781281097.278722:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800896:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.278755:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.278856:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:0.0:1781281097.278918:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010f1fe0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800896:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (388us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.278925:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16726 00000100:00100000:3.0:1781281097.282451:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.282577:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064800960 00000100:00100000:2.0:1781281097.282621:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16727 00000100:00100000:2.0:1781281097.282628:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085223d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800960:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.282681:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.282762:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.282826:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085223d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064800960:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 197us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.282834:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16727 00000100:00100000:1.0:1781281097.285408:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.285503:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801024 00000100:00100000:0.0:1781281097.285586:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16728 00000100:00100000:0.0:1781281097.285592:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eee05b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801024:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.285623:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.285708:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.285762:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eee05b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801024:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 170us (361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.285774:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16728 00000100:00100000:1.0:1781281097.292449:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.292648:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801088 00000100:00100000:2.0:1781281097.292706:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16729 00000100:00100000:2.0:1781281097.292714:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801088:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.292747:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.292850:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.292911:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006feda5c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801088:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 197us (471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.292923:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16729 00000100:00100000:3.0:1781281097.295895:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.295983:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801152 00000100:00100000:0.0:1781281097.296033:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16730 00000100:00100000:0.0:1781281097.296040:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6e19c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801152:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.296072:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.296177:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.296235:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6e19c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801152:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 194us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.296243:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16730 00000100:00100000:1.0:1781281097.300412:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.300505:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801216 00000100:00100000:2.0:1781281097.300602:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16731 00000100:00100000:2.0:1781281097.300609:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801216:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.300639:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.300720:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.300786:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c25c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801216:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 177us (381us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.300794:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16731 00000100:00100000:1.0:1781281097.303250:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.303333:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801280 00000100:00100000:0.0:1781281097.303390:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16732 00000100:00100000:0.0:1781281097.303398:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801280:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.303450:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.303597:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:0.0:1781281097.303647:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6571539 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801280:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 249us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.303655:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16732 00000100:00100000:3.0:1781281097.307635:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.307908:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801344 00000100:00100000:2.0:1781281097.307965:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16733 00000100:00100000:2.0:1781281097.307970:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049cc6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801344:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.308002:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.308085:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.308142:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049cc6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801344:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 171us (515us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.308150:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16733 00000100:00100000:1.0:1781281097.310703:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.310814:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801408 00000100:00100000:0.0:1781281097.310861:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16734 00000100:00100000:0.0:1781281097.310867:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801408:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.310899:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.310985:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.311040:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a94c2913 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801408:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 172us (343us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.311051:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16734 00000100:00100000:1.0:1781281097.314684:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.314822:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801472 00000100:00100000:2.0:1781281097.314874:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16735 00000100:00100000:2.0:1781281097.314881:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801472:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.314933:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.315018:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.315071:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024e55e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801472:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (394us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.315083:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16735 00000100:00100000:3.0:1781281097.321850:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.321937:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801536 00000100:00100000:0.0:1781281097.321995:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16736 00000100:00100000:0.0:1781281097.322002:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d09db4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801536:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.322035:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.322133:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:0.0:1781281097.322195:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d09db4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801536:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 192us (352us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.322203:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16736 00000100:00100000:1.0:1781281097.325736:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.325940:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801600 00000100:00100000:2.0:1781281097.325984:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16737 00000100:00100000:2.0:1781281097.325989:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801600:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.326019:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1ff:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.326103:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1ff:0x0]: rc = -2 00000100:00100000:2.0:1781281097.326163:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f96cbec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801600:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 172us (433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.326179:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16737 00000100:00100000:1.0:1781281097.328761:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.328869:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801664 00000100:00100000:0.0:1781281097.328917:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16738 00000100:00100000:0.0:1781281097.328923:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801664:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.328952:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.329043:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.329088:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069658a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801664:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 164us (334us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.329096:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16738 00000100:00100000:3.0:1781281097.332868:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.332950:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801728 00000100:00100000:2.0:1781281097.333002:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16739 00000100:00100000:2.0:1781281097.333008:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004585267b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801728:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.333038:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.333120:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.333185:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004585267b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801728:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 176us (325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.333193:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16739 00000100:00100000:1.0:1781281097.335945:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.336024:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801792 00000100:00100000:0.0:1781281097.336075:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16740 00000100:00100000:0.0:1781281097.336081:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801792:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.336131:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.336223:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.336278:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000122659dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801792:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.336290:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16740 00000100:00100000:1.0:1781281097.339450:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.339598:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801856 00000100:00100000:2.0:1781281097.339657:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16741 00000100:00100000:2.0:1781281097.339664:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e8744d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801856:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.339697:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.339802:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.339863:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e8744d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801856:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.339875:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16741 00000100:00100000:1.0:1781281097.344041:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.344193:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801920 00000100:00100000:2.0:1781281097.344248:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16742 00000100:00100000:2.0:1781281097.344255:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ff5501d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801920:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.344311:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.344403:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:2.0:1781281097.344462:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ff5501d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801920:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 207us (430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.344469:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16742 00000100:00100000:2.0:1781281097.347959:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.348162:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064801984 00000100:00100000:3.0:1781281097.348228:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16743 00000100:00100000:3.0:1781281097.348235:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfcfa9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801984:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.348270:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.348362:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:3.0:1781281097.348431:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfcfa9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064801984:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 195us (481us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.348440:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16743 00000100:00100000:1.0:1781281097.350938:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.351222:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802048 00000100:00100000:2.0:1781281097.351272:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16744 00000100:00100000:2.0:1781281097.351279:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbcdd77a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802048:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.351310:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.351391:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.351447:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbcdd77a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802048:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 167us (515us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.351454:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16744 00000100:00100000:0.0:1781281097.354603:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.354728:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802112 00000100:00100000:3.0:1781281097.354785:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16745 00000100:00100000:3.0:1781281097.354791:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000070c478 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802112:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.354849:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.354938:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.355002:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000070c478 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802112:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (405us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.355010:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16745 00000100:00100000:1.0:1781281097.362223:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.362313:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802176 00000100:00100000:2.0:1781281097.362366:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16746 00000100:00100000:2.0:1781281097.362373:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e8eef47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802176:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.362407:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.362517:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:2.0:1781281097.362611:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e8eef47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802176:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 236us (395us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.362620:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16746 00000100:00100000:1.0:1781281097.365450:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.365586:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802240 00000100:00100000:3.0:1781281097.365633:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16747 00000100:00100000:3.0:1781281097.365641:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052da9a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802240:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.365674:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.365776:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:3.0:1781281097.365837:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052da9a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802240:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.365845:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16747 00000100:00100000:0.0:1781281097.368367:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.368453:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802304 00000100:00100000:2.0:1781281097.368523:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16748 00000100:00100000:2.0:1781281097.368529:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ede073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802304:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.368599:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.368687:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:2.0:1781281097.368747:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ede073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802304:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 216us (386us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.368755:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16748 00000100:00100000:1.0:1781281097.372126:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.372220:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802368 00000100:00100000:3.0:1781281097.372275:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16749 00000100:00100000:3.0:1781281097.372282:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000761b412b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802368:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.372315:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.372401:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.372460:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000761b412b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802368:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (343us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.372468:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16749 00000100:00100000:1.0:1781281097.375420:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.375905:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802432 00000100:00100000:2.0:1781281097.375965:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16750 00000100:00100000:2.0:1781281097.375972:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7fad30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802432:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.376028:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.376124:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:2.0:1781281097.376190:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7fad30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802432:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 216us (780us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.376197:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16750 00000100:00100000:0.0:1781281097.379238:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.379326:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802496 00000100:00100000:3.0:1781281097.379379:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16751 00000100:00100000:3.0:1781281097.379386:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d03547c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802496:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.379416:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x222:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.379525:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x222:0x0]: rc = -2 00000100:00100000:3.0:1781281097.379608:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d03547c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802496:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 222us (376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.379616:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16751 00000100:00100000:1.0:1781281097.382062:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.382458:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802560 00000100:00100000:3.0:1781281097.382523:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16752 00000100:00100000:3.0:1781281097.382530:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002be707e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802560:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.382682:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.382774:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.382870:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002be707e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802560:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 339us (813us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.382877:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16752 00000100:00100000:1.0:1781281097.385725:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.385890:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802624 00000100:00100000:3.0:1781281097.385940:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16753 00000100:00100000:3.0:1781281097.385946:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036769f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802624:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.385977:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.386064:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.386157:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036769f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802624:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 210us (444us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.386177:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16753 00000100:00100000:1.0:1781281097.389075:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.389264:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802688 00000100:00100000:3.0:1781281097.389324:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16754 00000100:00100000:3.0:1781281097.389331:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005661f827 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802688:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.389365:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.389455:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.389598:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005661f827 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802688:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 266us (530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.389606:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16754 00000100:00100000:1.0:1781281097.392009:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.392071:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802752 00000100:00100000:3.0:1781281097.392116:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16755 00000100:00100000:3.0:1781281097.392122:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002bd739a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802752:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.392154:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.392244:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.392395:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002bd739a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802752:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 271us (391us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.392404:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16755 00000100:00100000:1.0:1781281097.394936:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.395345:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802816 00000100:00100000:3.0:1781281097.395400:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16756 00000100:00100000:3.0:1781281097.395406:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b24225e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802816:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.395455:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.395759:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:3.0:1781281097.395913:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b24225e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802816:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 505us (983us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.395925:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16756 00000100:00100000:2.0:1781281097.399221:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.399276:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802880 00000100:00100000:3.0:1781281097.399336:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16757 00000100:00100000:3.0:1781281097.399343:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004826100e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802880:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.399375:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.399468:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:3.0:1781281097.399978:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004826100e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802880:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 633us (763us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.399989:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16757 00000100:00100000:0.0:1781281097.402700:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.402825:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064802944 00000100:00100000:3.0:1781281097.402903:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16758 00000100:00100000:3.0:1781281097.402913:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da8466c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802944:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.402949:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.403049:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.403111:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da8466c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064802944:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 199us (423us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.403119:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16758 00000100:00100000:1.0:1781281097.406923:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.407070:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803008 00000100:00100000:3.0:1781281097.407128:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16759 00000100:00100000:3.0:1781281097.407135:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf8514d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803008:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.407178:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.407259:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.407314:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf8514d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803008:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (400us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.407326:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16759 00000100:00100000:2.0:1781281097.409716:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.409858:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803072 00000100:00100000:0.0:1781281097.409907:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16760 00000100:00100000:0.0:1781281097.409913:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000103a63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803072:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.409942:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.410019:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:0.0:1781281097.410067:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000103a63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803072:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 153us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.410074:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16760 00000100:00100000:0.0:1781281097.413867:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.414005:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803136 00000100:00100000:3.0:1781281097.414063:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16761 00000100:00100000:3.0:1781281097.414069:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000243992c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803136:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.414124:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.414225:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:3.0:1781281097.414289:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000243992c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803136:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 219us (431us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.414297:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16761 00000100:00100000:1.0:1781281097.417150:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.417450:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803200 00000100:00100000:0.0:1781281097.417518:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16762 00000100:00100000:0.0:1781281097.417524:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f65a123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803200:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.417585:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.417682:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:0.0:1781281097.417752:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f65a123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803200:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 228us (609us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.417769:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16762 00000100:00100000:2.0:1781281097.423042:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.423150:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803264 00000100:00100000:3.0:1781281097.423216:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16763 00000100:00100000:3.0:1781281097.423223:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099545b66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803264:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.423256:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.423351:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:3.0:1781281097.423413:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099545b66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803264:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 189us (392us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.423421:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16763 00000100:00100000:1.0:1781281097.428042:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.428804:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803328 00000100:00100000:0.0:1781281097.428865:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16764 00000100:00100000:0.0:1781281097.428871:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5544c15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803328:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.428905:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.428994:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.429050:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5544c15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803328:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 178us (1018us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.429058:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16764 00000100:00100000:1.0:1781281097.433925:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.434020:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803392 00000100:00100000:3.0:1781281097.434076:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16765 00000100:00100000:3.0:1781281097.434083:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1b8f82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803392:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.434117:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.434219:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.434280:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1b8f82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803392:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (363us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.434293:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16765 00000100:00100000:1.0:1781281097.437972:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.438145:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803456 00000100:00100000:0.0:1781281097.438221:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16766 00000100:00100000:0.0:1781281097.438228:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803456:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.438285:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.438384:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:0.0:1781281097.438445:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003861e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803456:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 217us (481us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.438454:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16766 00000100:00100000:1.0:1781281097.442292:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.442405:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803520 00000100:00100000:3.0:1781281097.442468:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16767 00000100:00100000:3.0:1781281097.442475:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf52b99e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803520:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.442518:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f9:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.442636:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f9:0x0]: rc = -2 00000100:00100000:3.0:1781281097.442684:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf52b99e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803520:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 209us (402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.442693:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16767 00000100:00100000:1.0:1781281097.446447:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.446814:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803584 00000100:00100000:0.0:1781281097.446888:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16768 00000100:00100000:0.0:1781281097.446896:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f84fd47f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803584:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.446936:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.447054:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:0.0:1781281097.447115:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f84fd47f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803584:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 219us (680us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.447123:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16768 00000100:00100000:1.0:1781281097.452794:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.453698:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803648 00000100:00100000:3.0:1781281097.453796:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16769 00000100:00100000:3.0:1781281097.453803:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028fcfe50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803648:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.453873:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x235:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.453970:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x235:0x0]: rc = -2 00000100:00100000:3.0:1781281097.454046:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028fcfe50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803648:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 243us (1262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.454055:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16769 00000100:00100000:1.0:1781281097.456791:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.457001:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803712 00000100:00100000:2.0:1781281097.457050:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16770 00000100:00100000:2.0:1781281097.457057:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000753563f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803712:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.457089:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x25f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.457189:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x25f:0x0]: rc = -2 00000100:00100000:2.0:1781281097.457239:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000753563f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803712:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 182us (457us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.457248:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16770 00000100:00100000:1.0:1781281097.460978:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.461300:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803776 00000100:00100000:3.0:1781281097.461361:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16771 00000100:00100000:3.0:1781281097.461368:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e1d53b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803776:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.461400:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x25f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.461519:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x25f:0x0]: rc = -2 00000100:00100000:3.0:1781281097.461601:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e1d53b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803776:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 232us (632us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.461613:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16771 00000100:00100000:1.0:1781281097.464522:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.464916:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803840 00000100:00100000:0.0:1781281097.464976:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16772 00000100:00100000:0.0:1781281097.464983:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4100bc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803840:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.465016:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.465110:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:0.0:1781281097.465507:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4100bc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803840:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 181us (651us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.465516:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16772 00000100:00100000:1.0:1781281097.469365:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.469465:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803904 00000100:00100000:2.0:1781281097.469530:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16773 00000100:00100000:2.0:1781281097.469537:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ac1405c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803904:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.469607:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.469706:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:2.0:1781281097.469775:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ac1405c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803904:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 238us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.469783:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16773 00000100:00100000:0.0:1781281097.473698:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.474077:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064803968 00000100:00100000:1.0:1781281097.474139:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16774 00000100:00100000:1.0:1781281097.474145:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db9e7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803968:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.474188:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.474272:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:1.0:1781281097.474332:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db9e7bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064803968:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 185us (641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.474339:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16774 00000100:00100000:0.0:1781281097.478749:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.478945:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804032 00000100:00100000:2.0:1781281097.479009:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16775 00000100:00100000:2.0:1781281097.479016:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d8435a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804032:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.479051:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.479138:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:2.0:1781281097.479207:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d8435a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804032:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (467us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.479215:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16775 00000100:00100000:0.0:1781281097.483586:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.484484:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804096 00000100:00100000:3.0:1781281097.484646:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16776 00000100:00100000:3.0:1781281097.484653:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000934db00a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804096:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.484688:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.484796:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:3.0:1781281097.485017:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000934db00a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804096:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 362us (1475us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.485026:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16776 00000100:00100000:1.0:1781281097.487320:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.488055:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804160 00000100:00100000:2.0:1781281097.488111:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16777 00000100:00100000:2.0:1781281097.488117:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000960d96e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804160:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1781281097.488189:0:6158:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1781281097.488277:0:6158:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:2.0:1781281097.488333:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000960d96e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804160:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 216us (1021us total) trans 0 rc -2/-2 00000100:00100000:2.0:1781281097.488343:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16777 00000100:00100000:1.0:1781281097.490818:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281097.490879:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804224 00000100:00100000:1.0:1781281097.490934:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16778 00000100:00100000:1.0:1781281097.490940:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055d94fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804224:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1781281097.490992:0:6155:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1781281097.491081:0:6155:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:1.0:1781281097.491130:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055d94fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804224:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 190us (320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1781281097.491141:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16778 00000100:00100000:2.0:1781281097.494400:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.494696:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804288 00000100:00100000:3.0:1781281097.494749:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16779 00000100:00100000:3.0:1781281097.494756:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001ff88d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804288:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.494798:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.495069:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:3.0:1781281097.495140:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001ff88d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804288:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 383us (747us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.495150:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16779 00000100:00100000:1.0:1781281097.498079:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.498337:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804352 00000100:00100000:0.0:1781281097.498395:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16780 00000100:00100000:0.0:1781281097.498402:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fbae0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804352:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.498443:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.498604:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:0.0:1781281097.498670:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fbae0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804352:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 267us (599us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.498680:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16780 00000100:00100000:1.0:1781281097.503224:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.503332:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804416 00000100:00100000:3.0:1781281097.503396:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16781 00000100:00100000:3.0:1781281097.503403:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031a7a158 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804416:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.503486:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.503639:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:3.0:1781281097.503691:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031a7a158 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804416:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 287us (476us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.503703:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16781 00000100:00100000:2.0:1781281097.506691:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.506803:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804480 00000100:00100000:0.0:1781281097.506855:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16782 00000100:00100000:0.0:1781281097.506861:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c4c632 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804480:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.506922:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.507011:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:0.0:1781281097.507057:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c4c632 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804480:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (375us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.507065:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16782 00000100:00100000:1.0:1781281097.510715:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.511024:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804544 00000100:00100000:3.0:1781281097.511081:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16783 00000100:00100000:3.0:1781281097.511088:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ae8ff1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804544:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.511119:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.511221:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1f1:0x0]: rc = -2 00000100:00100000:3.0:1781281097.511285:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ae8ff1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804544:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.511293:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16783 00000100:00100000:1.0:1781281097.515025:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.515118:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804608 00000100:00100000:0.0:1781281097.515187:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16784 00000100:00100000:0.0:1781281097.515194:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb238fa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804608:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.515231:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.515329:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:0.0:1781281097.515392:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb238fa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804608:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 197us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.515400:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16784 00000100:00100000:2.0:1781281097.520014:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.520116:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804672 00000100:00100000:3.0:1781281097.520185:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16785 00000100:00100000:3.0:1781281097.520193:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003124d9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804672:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.520233:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.520330:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:3.0:1781281097.520394:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003124d9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804672:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 201us (388us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.520402:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16785 00000100:00100000:1.0:1781281097.526646:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.527120:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804736 00000100:00100000:0.0:1781281097.527188:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16786 00000100:00100000:0.0:1781281097.527195:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c25dc0f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804736:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.527231:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.527326:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e3:0x0]: rc = -2 00000100:00100000:0.0:1781281097.527392:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c25dc0f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804736:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 196us (755us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.527400:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16786 00000100:00100000:1.0:1781281097.533044:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.533228:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804800 00000100:00100000:3.0:1781281097.533297:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16787 00000100:00100000:3.0:1781281097.533304:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000240f84e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804800:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.533342:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.533444:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e3:0x0]: rc = -2 00000100:00100000:3.0:1781281097.533592:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000240f84e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804800:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 287us (557us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.533605:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16787 00000100:00100000:2.0:1781281097.537153:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.537338:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804864 00000100:00100000:0.0:1781281097.537397:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16788 00000100:00100000:0.0:1781281097.537404:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f51ff809 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804864:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.537446:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.537605:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:0.0:1781281097.537657:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f51ff809 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804864:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 252us (518us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.537665:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16788 00000100:00100000:1.0:1781281097.541676:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.541789:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804928 00000100:00100000:3.0:1781281097.541850:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16789 00000100:00100000:3.0:1781281097.541857:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0cda0f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804928:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.541914:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x22d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.541999:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x22d:0x0]: rc = -2 00000100:00100000:3.0:1781281097.542056:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0cda0f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804928:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 198us (386us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.542064:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16789 00000100:00100000:1.0:1781281097.546384:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.546518:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064804992 00000100:00100000:0.0:1781281097.546607:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16790 00000100:00100000:0.0:1781281097.546614:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004de6a1fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804992:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.546666:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.546756:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:0.0:1781281097.546806:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004de6a1fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064804992:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 191us (432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.546814:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16790 00000100:00100000:2.0:1781281097.550884:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.551085:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805056 00000100:00100000:3.0:1781281097.551138:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16791 00000100:00100000:3.0:1781281097.551145:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000114f450b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805056:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.551189:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.551274:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:3.0:1781281097.551334:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000114f450b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805056:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 189us (460us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.551341:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16791 00000100:00100000:1.0:1781281097.555680:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.555980:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805120 00000100:00100000:0.0:1781281097.556041:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16792 00000100:00100000:0.0:1781281097.556048:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef55e565 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805120:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1781281097.556087:0:14242:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1781281097.556195:0:14242:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:0.0:1781281097.556258:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef55e565 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805120:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 208us (586us total) trans 0 rc -2/-2 00000100:00100000:0.0:1781281097.556265:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16792 00000100:00100000:1.0:1781281097.560422:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.560593:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805184 00000100:00100000:3.0:1781281097.560640:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16793 00000100:00100000:3.0:1781281097.560647:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d1ffec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805184:12345-192.168.202.40@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1781281097.560679:0:15255:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x1e4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1781281097.560778:0:15255:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x1e4:0x0]: rc = -2 00000100:00100000:3.0:1781281097.560965:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d1ffec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+496:12568:x1867808064805184:12345-192.168.202.40@tcp:53:lustre_rsync.0 Request processed in 317us (551us total) trans 0 rc -2/-2 00000100:00100000:3.0:1781281097.560978:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16793 00010000:00010000:0.0:1781281097.807965:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1781281097.895675:0:6178:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975698 is committed 00000004:00080000:3.0:1781281097.895697:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00000004:00080000:3.0:1781281097.895845:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000004:00080000:3.0:1781281097.895938:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000004:00080000:3.0:1781281097.896462:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000004:00080000:3.0:1781281097.896516:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000004:00080000:3.0:1781281097.896595:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000100:00100000:3.0:1781281097.897005:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0d70729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.897252:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.897282:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ece1721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.897302:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.897326:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1781281097.897331:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009dfc4c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.897348:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.897362:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004f49510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.897379:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.897412:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778112 00000100:00100000:3.0:1781281097.897449:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778368 00000100:00100000:3.0:1781281097.897463:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778048 00000100:00100000:3.0:1781281097.897486:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778304 00000100:00100000:3.0:1781281097.897503:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1781281097.897508:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3176:x1867808083778112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.897535:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:229 count 1 00010000:00010000:3.0:1781281097.897581:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.897606:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 70 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.897614:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.897615:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.897617:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 4/0,1 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.897644:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 3/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 70 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.897656:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 4/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 70 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.897665:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083778560:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.897713:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 000000001a4b0011 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.897730:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:3.0:1781281097.897734:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3176:x1867808083778368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.897746:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:230 count 1 00010000:00010000:3.0:1781281097.897756:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898328:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 70 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898334:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898336:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898338:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 4/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898359:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 70 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898367:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.898375:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f1a637c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083779136:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.898404:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e7a2223c going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.898424:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1781281097.898429:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398f68c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3176:x1867808083778048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.898444:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:228 count 1 00010000:00010000:3.0:1781281097.898455:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898466:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 70 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898485:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898486:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898487:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 4/0,1 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898505:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 3/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 70 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898518:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 4/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.898525:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008544c56b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083779200:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.898578:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000d2812a going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.898593:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1781281097.898597:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008362d394 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3176:x1867808083778304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.898608:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:225 count 1 00010000:00010000:3.0:1781281097.898619:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898628:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 70 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898633:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898634:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.898635:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 4/0,1 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898650:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 70 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.898657:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 70 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.898665:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083779264:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.898685:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 00000000acb0b455 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.898716:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024d058b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.898745:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1781281097.898882:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898892:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898899:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898904:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005d15d38 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.898907:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898914:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898928:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xe93b25ce (00000000910fb975) 00010000:00010000:1.0:1781281097.898931:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.898935:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898940:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005d15d38/0xce40b48e7cd20cc2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898958:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898964:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898969:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898973:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cbdb2393 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.898974:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898979:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898985:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ee:0x0].0x0 (0000000094032114) 00010000:00010000:1.0:1781281097.898988:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.898989:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.898994:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd20cc9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899030:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899036:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899042:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899047:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f66e671b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899049:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899217:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899226:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xe2501d74 (0000000021d00673) 00010000:00010000:1.0:1781281097.899228:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.899230:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899235:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f66e671b/0xce40b48e7cd20cde lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899247:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899252:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899262:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899267:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000001e120ad already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899269:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899274:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899281:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f0:0x0].0x0 (00000000e61e0a6a) 00010000:00010000:1.0:1781281097.899283:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.899285:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899290:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000001e120ad/0xce40b48e7cd20ce5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899321:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899327:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899332:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899336:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000028abc93e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899339:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899344:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899352:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xbf0c4e99 (000000006742f538) 00010000:00010000:1.0:1781281097.899354:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.899356:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899361:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000028abc93e/0xce40b48e7cd20cfa lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899373:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899378:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899382:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899386:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000047d421f6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899388:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899392:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899398:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e7:0x0].0x0 (00000000024ab4dd) 00010000:00010000:1.0:1781281097.899400:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.899402:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899407:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047d421f6/0xce40b48e7cd20d01 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899421:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899427:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899432:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899437:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ea9f0d27 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899439:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899445:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899452:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x8e4542d7 (00000000f1cc594a) 00010000:00010000:1.0:1781281097.899454:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.899455:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899460:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9f0d27/0xce40b48e7cd20d63 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899470:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899486:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899491:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899496:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb2e4c0a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899498:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899502:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899509:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ea:0x0].0x0 (000000003452565a) 00010000:00010000:1.0:1781281097.899511:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.899513:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899518:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb2e4c0a/0xce40b48e7cd20d6a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899536:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899571:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899577:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899586:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b04c8dc already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899588:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899594:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899601:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xd8045a37 (000000008f73849c) 00010000:00010000:1.0:1781281097.899603:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.899605:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899610:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b04c8dc/0xce40b48e7cd20da2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899621:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899626:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899631:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899636:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000150e198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899637:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899641:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899647:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ec:0x0].0x0 (00000000d14072dc) 00010000:00010000:1.0:1781281097.899649:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.899651:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899656:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000150e198/0xce40b48e7cd20da9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899670:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899676:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899681:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899686:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000059ed932 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899688:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899693:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899701:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xbf0c4e99 (0000000013ab509b) 00010000:00010000:1.0:1781281097.899703:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.899704:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899714:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000059ed932/0xce40b48e7cd20dc5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899724:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899730:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899735:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899740:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000047224f8f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.899742:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899747:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.899753:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e8:0x0].0x0 (0000000017dc8012) 00010000:00010000:1.0:1781281097.899755:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.899756:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900455:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047224f8f/0xce40b48e7cd20dcc lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900489:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900498:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900505:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900510:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094f6cca0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.900513:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900519:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900528:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xe93b25ce (00000000f2b88adc) 00010000:00010000:1.0:1781281097.900531:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.900533:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900538:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094f6cca0/0xce40b48e7cd20dfd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900577:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900583:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900587:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900596:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000032155a23 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.900597:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900602:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900610:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ed:0x0].0x0 (000000002c42f3e9) 00010000:00010000:1.0:1781281097.900611:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.900613:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900618:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032155a23/0xce40b48e7cd20e04 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900633:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900639:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900644:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900649:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053d4a9ba already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.900651:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900656:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900663:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x17610ee3 (00000000390f773f) 00010000:00010000:1.0:1781281097.900665:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.900667:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900671:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053d4a9ba/0xce40b48e7cd20e12 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900681:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900686:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900691:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900695:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009eee1159 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.900697:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900701:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900707:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x383:0x0].0x0 (000000003336bbc7) 00010000:00010000:1.0:1781281097.900709:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.900710:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900719:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009eee1159/0xce40b48e7cd20e19 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x383:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900732:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900738:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900743:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900748:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003c902aad already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.900750:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.900754:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.900948:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065093734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.901001:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.901032:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1781281097.901038:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0664d22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281097.901186:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778688 00000100:00100000:0.0:1781281097.901224:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778944 00000100:00100000:0.0:1781281097.901241:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:0.0:1781281097.901245:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ce960b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3176:x1867808083778688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281097.901271:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:228 count 1 00010000:00010000:0.0:1781281097.901291:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.901307:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 73 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.901313:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.901315:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.901317:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 4/0,1 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.901349:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 3/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 73 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.901360:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 4/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 73 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.901370:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083779328:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281097.901410:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 000000007b87d8b9 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.901453:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1781281097.901518:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x4e78d319 (000000000acfe451) 00010000:00010000:1.0:1781281097.901520:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.901523:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901530:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003c902aad/0xce40b48e7cd20e74 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901564:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901573:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901577:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901582:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c8f5194 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901584:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901589:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901596:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f4:0x0].0x0 (0000000063f0b724) 00010000:00010000:1.0:1781281097.901598:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.901600:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901605:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c8f5194/0xce40b48e7cd20e7b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901622:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901627:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901633:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901642:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043e2cd09 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901643:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901649:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901655:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x220bffe4 (00000000c211aa3b) 00010000:00010000:1.0:1781281097.901657:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.901659:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901664:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043e2cd09/0xce40b48e7cd20e9e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901675:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901680:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901685:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901690:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a5c7cb5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901691:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901696:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901702:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x389:0x0].0x0 (000000000c36adfb) 00010000:00010000:1.0:1781281097.901704:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.901705:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901711:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a5c7cb5/0xce40b48e7cd20ea5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901724:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901730:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901735:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901740:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f5f71123 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901743:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901748:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901754:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xcd7d97c8 (000000008b88ca7d) 00010000:00010000:1.0:1781281097.901757:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.901771:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901781:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f5f71123/0xce40b48e7cd20eb3 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901795:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901801:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901805:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901810:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ae147d4c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901812:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901818:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901825:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x234:0x0].0x0 (000000002bab6da6) 00010000:00010000:1.0:1781281097.901826:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.901840:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 2/0,0 mode: --/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901845:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae147d4c/0xce40b48e7cd20eba lrc: 0/0,0 mode: --/COS res: [0x200000402:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901859:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901869:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901874:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901879:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a239c66e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901881:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901886:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901892:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x30480a6c (00000000d0011fa1) 00010000:00010000:1.0:1781281097.901894:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.901896:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901901:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a239c66e/0xce40b48e7cd20ecf lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901911:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901917:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901922:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901931:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000fb51646 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901933:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901938:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901944:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f6:0x0].0x0 (00000000019a883c) 00010000:00010000:1.0:1781281097.901946:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.901948:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901952:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000fb51646/0xce40b48e7cd20ed6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901965:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901970:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901976:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901980:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000969d5765 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.901982:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901987:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.901994:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xb0449b87 (00000000f8403935) 00010000:00010000:1.0:1781281097.901996:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.901998:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902004:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000969d5765/0xce40b48e7cd20eeb lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902015:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902020:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902025:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902030:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b11c9a1d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902032:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902037:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902043:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x38d:0x0].0x0 (000000007f54b4c0) 00010000:00010000:1.0:1781281097.902045:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902047:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902066:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b11c9a1d/0xce40b48e7cd20ef2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902081:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902087:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902092:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902097:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000032dffb32 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902098:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902103:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902110:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x283705e2 (0000000069107448) 00010000:00010000:1.0:1781281097.902112:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902114:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902119:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000032dffb32/0xce40b48e7cd20f07 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902129:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902137:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902142:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902146:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000066f0ad5d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902148:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902153:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902160:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39d:0x0].0x0 (000000009603256c) 00010000:00010000:1.0:1781281097.902162:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902163:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902168:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066f0ad5d/0xce40b48e7cd20f0e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902181:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902187:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902192:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902200:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ce52bfe4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902201:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902206:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902212:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x8344d724 (000000005676ce9a) 00010000:00010000:1.0:1781281097.902214:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902215:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902220:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce52bfe4/0xce40b48e7cd20f23 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902230:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902234:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902239:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902243:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0693da4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902245:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902249:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902255:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f8:0x0].0x0 (00000000a8fb9562) 00010000:00010000:1.0:1781281097.902257:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902258:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902263:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0693da4/0xce40b48e7cd20f2a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902276:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902281:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902286:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902290:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000536d6bb6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902292:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902296:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902303:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x103f9c81 (0000000072b6f67d) 00010000:00010000:1.0:1781281097.902305:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902306:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902316:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000536d6bb6/0xce40b48e7cd20f3f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902325:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902330:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902335:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902340:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000042b334ba already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902342:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902347:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902353:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x242:0x0].0x0 (00000000ca557496) 00010000:00010000:1.0:1781281097.902355:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902357:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902362:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000042b334ba/0xce40b48e7cd20f46 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902375:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902384:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902389:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902395:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000855bda6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902397:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902402:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902409:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xc3f00931 (000000003dcc4780) 00010000:00010000:1.0:1781281097.902411:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902412:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902417:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000855bda6/0xce40b48e7cd20f77 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902427:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902433:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902438:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902447:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000924799a9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902450:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902455:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902462:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x240:0x0].0x0 (00000000609343e4) 00010000:00010000:1.0:1781281097.902464:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902466:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902471:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000924799a9/0xce40b48e7cd20f7e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902495:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902500:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902505:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902510:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000076d35719 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902512:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902518:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902525:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x3afecd66 (00000000d9241932) 00010000:00010000:1.0:1781281097.902527:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902529:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902534:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076d35719/0xce40b48e7cd20f9a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902570:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902576:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902582:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902586:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a7ec9ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902588:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902593:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902612:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x254:0x0].0x0 (00000000d4e8571b) 00010000:00010000:1.0:1781281097.902614:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902616:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902627:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a7ec9ec/0xce40b48e7cd20fa1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902641:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902646:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902651:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902657:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000023d181d1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902658:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902664:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902671:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xf2061246 (00000000d1ff9901) 00010000:00010000:1.0:1781281097.902673:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902674:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902680:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000023d181d1/0xce40b48e7cd20fbd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902690:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902699:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902703:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902708:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000670cdc95 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902710:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902715:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902723:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24e:0x0].0x0 (00000000a342a45b) 00010000:00010000:1.0:1781281097.902725:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902727:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902732:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000670cdc95/0xce40b48e7cd20fc4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902747:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902753:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902757:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902765:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cd9cc694 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902767:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902772:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902779:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xcbe2ca0f (0000000096e5d688) 00010000:00010000:1.0:1781281097.902781:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902783:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902789:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd9cc694/0xce40b48e7cd20fd2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902800:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902805:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902810:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902814:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052da6c13 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902816:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902821:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902829:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x223:0x0].0x0 (00000000bd179f84) 00010000:00010000:1.0:1781281097.902831:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902833:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902838:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052da6c13/0xce40b48e7cd20fd9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902851:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902857:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902862:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902867:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000916ca3dc already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902869:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902873:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902879:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x21e72734 (00000000143d545a) 00010000:00010000:1.0:1781281097.902881:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902883:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902893:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000916ca3dc/0xce40b48e7cd20fee lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902903:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902908:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902913:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902917:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f1ef8e9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902919:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902924:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902931:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25a:0x0].0x0 (000000002a08f3f2) 00010000:00010000:1.0:1781281097.902933:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.902935:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902940:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f1ef8e9/0xce40b48e7cd20ff5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902954:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902965:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902971:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902975:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fac93402 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.902977:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902982:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902989:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x10cfb8f0 (00000000da5ecacc) 00010000:00010000:1.0:1781281097.902991:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.902993:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.902998:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fac93402/0xce40b48e7cd2100a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903007:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903012:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903016:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903024:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000086747f9d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903026:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903031:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903038:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21f:0x0].0x0 (0000000020ee1426) 00010000:00010000:1.0:1781281097.903040:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.903042:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903046:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000086747f9d/0xce40b48e7cd21011 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903059:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903065:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903070:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903075:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c4098104 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903077:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903082:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903090:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xbcf75103 (00000000606951b7) 00010000:00010000:1.0:1781281097.903092:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.903094:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903098:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4098104/0xce40b48e7cd21026 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903109:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903114:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903119:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903123:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a51be36f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903124:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903129:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903135:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x250:0x0].0x0 (0000000083cd5eb1) 00010000:00010000:1.0:1781281097.903137:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.903139:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903148:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a51be36f/0xce40b48e7cd2102d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903162:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903167:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903173:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903177:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da8b8c8b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903179:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903184:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903191:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x9062bf83 (00000000720a4b67) 00010000:00010000:1.0:1781281097.903193:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.903195:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903200:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000da8b8c8b/0xce40b48e7cd21042 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903210:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903219:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903224:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903229:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000eae1aa5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903231:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903236:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903242:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x221:0x0].0x0 (000000007d0644cb) 00010000:00010000:1.0:1781281097.903244:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.903245:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903250:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000eae1aa5/0xce40b48e7cd21049 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903265:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903271:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903276:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903285:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000057a67d61 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903287:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903292:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903299:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xca0b3ea (00000000e2ab4025) 00010000:00010000:1.0:1781281097.903301:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.903302:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903308:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057a67d61/0xce40b48e7cd2105e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903318:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903323:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903328:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903332:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000d073645 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903334:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903339:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903345:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x238:0x0].0x0 (000000006e283d4f) 00010000:00010000:1.0:1781281097.903347:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.903349:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903353:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000d073645/0xce40b48e7cd21065 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903366:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903371:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903377:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903382:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009b5eb333 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903383:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903388:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903395:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x1e0192a5 (00000000410e827e) 00010000:00010000:1.0:1781281097.903397:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.903398:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903408:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009b5eb333/0xce40b48e7cd2107a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903417:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903422:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903427:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903432:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004713c698 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.903434:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903439:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903445:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x219:0x0].0x0 (00000000f8db1abb) 00010000:00010000:1.0:1781281097.903447:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.903448:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903453:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004713c698/0xce40b48e7cd21081 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.903467:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.903573:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7e79b84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.903633:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.904218:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f87dee6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778176:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1781281097.908607:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908620:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908626:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aec8e868 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.908630:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908638:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908656:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x8ee21578 (000000005de999b0) 00010000:00010000:1.0:1781281097.908659:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.908663:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908669:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aec8e868/0xce40b48e7cd21096 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908691:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908697:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908701:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908712:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000acb6254 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.908713:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908719:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908726:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39b:0x0].0x0 (000000002dbfad65) 00010000:00010000:1.0:1781281097.908728:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.908730:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908735:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000acb6254/0xce40b48e7cd2109d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x39b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908768:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908774:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908779:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908784:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a8a582f9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.908786:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908791:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908799:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x801dd473 (00000000742bbe43) 00010000:00010000:1.0:1781281097.908801:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.908803:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908807:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8a582f9/0xce40b48e7cd210b2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908817:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908821:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908928:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908936:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009310b1d9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.908938:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908943:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908951:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21b:0x0].0x0 (000000005eeae6e6) 00010000:00010000:1.0:1781281097.908954:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.908956:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908966:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009310b1d9/0xce40b48e7cd210b9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908982:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908988:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908993:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.908998:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b96f5953 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909000:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909005:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909012:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x17d46a (000000003e98d5b7) 00010000:00010000:1.0:1781281097.909014:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.909016:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909021:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b96f5953/0xce40b48e7cd210ce lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909035:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909045:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909049:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909130:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a729086e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909132:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909137:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909146:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23e:0x0].0x0 (0000000099b019b5) 00010000:00010000:1.0:1781281097.909148:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.909150:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909155:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a729086e/0xce40b48e7cd210d5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909287:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909294:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909299:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909309:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f2f64278 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909311:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909316:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909323:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x5a3b2e4f (00000000f5a2dddf) 00010000:00010000:1.0:1781281097.909325:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.909327:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909333:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f2f64278/0xce40b48e7cd210ea lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909343:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909348:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909353:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909358:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cd16866f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909360:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909365:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909372:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x213:0x0].0x0 (000000001c8eb13a) 00010000:00010000:1.0:1781281097.909373:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.909375:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909379:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd16866f/0xce40b48e7cd210f1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909394:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909400:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909406:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909411:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d3b11c53 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909413:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909418:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909424:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xa5e17578 (0000000019ec0372) 00010000:00010000:1.0:1781281097.909426:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.909428:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909437:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d3b11c53/0xce40b48e7cd21106 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909449:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909454:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909459:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909464:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b9cc4a9b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909466:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909482:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909489:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23a:0x0].0x0 (000000005f3d5608) 00010000:00010000:1.0:1781281097.909490:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.909492:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909745:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9cc4a9b/0xce40b48e7cd2110d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909773:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909784:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909789:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909794:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000baef5573 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909796:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909801:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909808:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xd60b5417 (000000005e66bc2b) 00010000:00010000:1.0:1781281097.909810:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.909812:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909818:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000baef5573/0xce40b48e7cd21122 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909843:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909849:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909854:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909864:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000986b2d6b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909867:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909872:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909879:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x217:0x0].0x0 (00000000ea2b21e9) 00010000:00010000:1.0:1781281097.909881:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.909883:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909889:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000986b2d6b/0xce40b48e7cd21129 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909903:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909909:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909914:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909919:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004419fc48 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909921:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909926:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909933:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x98ca20bd (0000000028532198) 00010000:00010000:1.0:1781281097.909936:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.909938:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909943:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004419fc48/0xce40b48e7cd2113e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909955:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909961:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909966:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909971:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004d03609 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.909973:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909979:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909986:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x252:0x0].0x0 (00000000eaddeed4) 00010000:00010000:1.0:1781281097.909988:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.909990:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.909999:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004d03609/0xce40b48e7cd21145 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910015:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910021:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910027:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910031:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007b3586af already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910033:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910038:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910045:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xbfd87aeb (00000000b65a5f9b) 00010000:00010000:1.0:1781281097.910047:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910049:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910064:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007b3586af/0xce40b48e7cd2115a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910074:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910084:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910089:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910093:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000852a0659 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910096:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910101:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910107:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20f:0x0].0x0 (000000003342ddda) 00010000:00010000:1.0:1781281097.910109:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910110:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910115:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000852a0659/0xce40b48e7cd21161 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910128:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910133:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910138:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910146:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bccea041 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910148:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910152:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910170:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x5a114248 (0000000052ea8322) 00010000:00010000:1.0:1781281097.910172:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910174:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910179:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bccea041/0xce40b48e7cd21176 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910188:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910193:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910198:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910203:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e6cf10a6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910205:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910210:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910216:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x391:0x0].0x0 (000000008e5c50fc) 00010000:00010000:1.0:1781281097.910218:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910220:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910225:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6cf10a6/0xce40b48e7cd2117d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910238:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910245:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910249:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910255:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2b67371 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910256:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910261:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910268:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xa3962d5b (00000000b09df161) 00010000:00010000:1.0:1781281097.910270:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910272:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910282:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c2b67371/0xce40b48e7cd211a7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910293:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910298:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910303:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910308:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bfc3f695 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910310:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910315:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910323:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x258:0x0].0x0 (000000003d7deaa6) 00010000:00010000:1.0:1781281097.910325:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910327:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 2/0,0 mode: --/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910331:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bfc3f695/0xce40b48e7cd211ae lrc: 0/0,0 mode: --/COS res: [0x200000402:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910344:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910353:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910357:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910362:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3034da2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910364:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910368:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910375:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xee1a16ec (000000003c8da993) 00010000:00010000:1.0:1781281097.910377:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910378:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910382:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3034da2/0xce40b48e7cd21192 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910392:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910398:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910403:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910411:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000be194d04 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910413:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910418:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910425:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21d:0x0].0x0 (0000000012777891) 00010000:00010000:1.0:1781281097.910427:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910428:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910433:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000be194d04/0xce40b48e7cd21199 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910446:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910452:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910458:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910463:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000086c3b265 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910465:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910470:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910488:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x2ee4e5f8 (0000000044ce0065) 00010000:00010000:1.0:1781281097.910490:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910493:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910510:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000086c3b265/0xce40b48e7cd211ca lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910520:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910525:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910529:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910534:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000062a48d2b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910535:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910559:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910567:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x244:0x0].0x0 (0000000097a35972) 00010000:00010000:1.0:1781281097.910569:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910571:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910580:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062a48d2b/0xce40b48e7cd211d1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910595:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910601:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910605:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910610:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e188bb78 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910612:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910617:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910624:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xc5f130b7 (0000000047ead7b5) 00010000:00010000:1.0:1781281097.910626:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910627:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910632:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e188bb78/0xce40b48e7cd211e6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910642:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910650:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910655:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910660:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000176d5151 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910661:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910666:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910671:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x215:0x0].0x0 (00000000f0ccaad0) 00010000:00010000:1.0:1781281097.910673:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910674:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 2/0,0 mode: --/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910678:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000176d5151/0xce40b48e7cd211ed lrc: 0/0,0 mode: --/COS res: [0x200000402:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910692:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910697:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910702:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910709:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d6cc3ceb already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910710:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910715:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910722:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x5e0db83a (0000000053ed986e) 00010000:00010000:1.0:1781281097.910724:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910725:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910730:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cc3ceb/0xce40b48e7cd21202 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910741:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910746:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910751:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910756:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000091a4f0b6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910758:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910764:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910771:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x236:0x0].0x0 (00000000e0a65966) 00010000:00010000:1.0:1781281097.910773:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910775:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910780:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000091a4f0b6/0xce40b48e7cd21209 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910795:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910801:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910806:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910811:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000853f7b12 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910812:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910817:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910823:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0xb65fef2a (00000000e99b6916) 00010000:00010000:1.0:1781281097.910825:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910826:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910835:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000853f7b12/0xce40b48e7cd2121e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910847:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910854:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910858:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910863:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000997c05bf already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910864:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910869:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910876:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x211:0x0].0x0 (000000007eb77f68) 00010000:00010000:1.0:1781281097.910878:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910879:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910885:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000997c05bf/0xce40b48e7cd21225 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910898:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910908:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910913:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910918:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006a66655 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910920:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910926:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910931:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x9e362f1b (00000000734acab8) 00010000:00010000:1.0:1781281097.910933:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.910935:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910940:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006a66655/0xce40b48e7cd2128e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910951:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910957:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910962:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910971:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000020fcd940 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.910973:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910978:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910984:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24c:0x0].0x0 (00000000aafc3dbe) 00010000:00010000:1.0:1781281097.910986:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.910988:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.910993:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020fcd940/0xce40b48e7cd21295 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911006:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911012:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911017:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911022:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b40e0664 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911024:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911029:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911036:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x51a4c572 (00000000d351d932) 00010000:00010000:1.0:1781281097.911038:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911040:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911045:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b40e0664/0xce40b48e7cd212b1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911055:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911060:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911064:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911068:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8d5f517 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911071:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911075:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911081:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x246:0x0].0x0 (000000001fc861df) 00010000:00010000:1.0:1781281097.911083:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911085:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911093:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d5f517/0xce40b48e7cd212b8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911109:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911115:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911120:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911125:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf86d67e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911127:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911132:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911139:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x76821429 (00000000c6c6d716) 00010000:00010000:1.0:1781281097.911141:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911143:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911148:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf86d67e/0xce40b48e7cd212d4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911159:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911168:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911173:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911178:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004eb695f8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911180:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911185:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911191:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24a:0x0].0x0 (00000000cbb89717) 00010000:00010000:1.0:1781281097.911193:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911195:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911200:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004eb695f8/0xce40b48e7cd212db lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911215:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911220:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911225:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911234:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ddd0e279 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911236:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911241:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911248:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xf4ed591 (000000000df4fed4) 00010000:00010000:1.0:1781281097.911251:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911252:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911257:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ddd0e279/0xce40b48e7cd212e9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911267:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911273:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911278:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911282:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f493b40a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911284:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911289:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911295:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x206:0x0].0x0 (00000000ff1a171b) 00010000:00010000:1.0:1781281097.911297:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911299:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911303:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f493b40a/0xce40b48e7cd212f0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911319:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911325:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911330:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911335:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000077f3d35f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911337:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911342:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911349:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x6324417e (0000000070b84328) 00010000:00010000:1.0:1781281097.911351:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911352:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911362:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000077f3d35f/0xce40b48e7cd21305 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911374:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911379:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911384:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911390:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b9b5863 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911391:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911396:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911404:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x248:0x0].0x0 (00000000277c4245) 00010000:00010000:1.0:1781281097.911406:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911407:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911412:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b9b5863/0xce40b48e7cd2130c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911426:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911436:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911441:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911446:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003895f3ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911448:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911453:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911461:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x6428115e (00000000d7b27fa0) 00010000:00010000:1.0:1781281097.911463:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911465:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911470:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003895f3ec/0xce40b48e7cd21336 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911502:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911508:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911513:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911520:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004203ab9c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911522:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911526:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911532:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x202:0x0].0x0 (0000000073d09258) 00010000:00010000:1.0:1781281097.911534:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911535:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911564:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004203ab9c/0xce40b48e7cd2133d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911589:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911594:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911598:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911603:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000399ee9ef already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911605:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911609:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911617:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0xbea011c (000000004759d1fd) 00010000:00010000:1.0:1781281097.911619:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911621:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911626:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000399ee9ef/0xce40b48e7cd21321 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911635:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911640:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911645:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911650:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001c169d3f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911651:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911656:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911662:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x256:0x0].0x0 (000000008a983cf5) 00010000:00010000:1.0:1781281097.911664:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911665:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911674:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001c169d3f/0xce40b48e7cd21328 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911688:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911693:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911698:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911703:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d5c5bead already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911705:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911710:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911717:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x1674e29a (0000000017cd9f8a) 00010000:00010000:1.0:1781281097.911719:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911721:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911726:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d5c5bead/0xce40b48e7cd21359 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911737:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911747:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911752:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911757:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d3e097a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911759:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911764:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911770:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23c:0x0].0x0 (00000000990336ae) 00010000:00010000:1.0:1781281097.911772:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911774:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911779:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d3e097a/0xce40b48e7cd21360 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911793:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911798:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911803:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911812:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004fafd4e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911813:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911818:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911826:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x469e1765 (000000002615b5c4) 00010000:00010000:1.0:1781281097.911827:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911829:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911835:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004fafd4e/0xce40b48e7cd21375 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911845:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911850:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911856:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911861:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007ac1952a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911862:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911868:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911875:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x208:0x0].0x0 (00000000a6f18b60) 00010000:00010000:1.0:1781281097.911877:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911879:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911883:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007ac1952a/0xce40b48e7cd2137c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911896:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911901:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911906:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911910:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000340e98dd already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911912:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911917:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911923:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xa36e7a4 (00000000b48a84b7) 00010000:00010000:1.0:1781281097.911925:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.911927:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911936:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000340e98dd/0xce40b48e7cd213c9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911946:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911950:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911954:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911959:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002b1b9244 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.911961:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911966:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911971:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36c:0x0].0x0 (000000009cc2ebfc) 00010000:00010000:1.0:1781281097.911973:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.911975:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911979:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002b1b9244/0xce40b48e7cd213d0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.911991:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912001:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912006:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912011:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f5a1775 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912013:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912018:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912026:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xe5dc7a0b (000000004f6886fa) 00010000:00010000:1.0:1781281097.912028:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.912030:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912035:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f5a1775/0xce40b48e7cd213f3 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912046:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912052:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912057:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912065:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043d2c912 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912068:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912073:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912080:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x204:0x0].0x0 (000000001ca491ee) 00010000:00010000:1.0:1781281097.912082:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.912084:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 2/0,0 mode: --/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912089:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043d2c912/0xce40b48e7cd213fa lrc: 0/0,0 mode: --/COS res: [0x200000402:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912104:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912109:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912114:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912119:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d607d92 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912121:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912126:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912133:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0xdde1c156 (00000000be12aa82) 00010000:00010000:1.0:1781281097.912135:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.912137:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912141:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d607d92/0xce40b48e7cd21408 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912153:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912158:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912162:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912167:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a8e7d44f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912169:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912174:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912180:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25e:0x0].0x0 (00000000ef36d1c8) 00010000:00010000:1.0:1781281097.912182:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.912184:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912193:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8e7d44f/0xce40b48e7cd2140f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912206:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912211:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912217:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912222:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006f8b8042 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912223:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912229:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912236:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xc3d50206 (0000000050f37f98) 00010000:00010000:1.0:1781281097.912238:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.912240:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912246:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f8b8042/0xce40b48e7cd21478 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912257:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912266:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912271:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912276:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073bb39ee already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912279:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912284:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912291:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20b:0x0].0x0 (000000005ec30d0c) 00010000:00010000:1.0:1781281097.912293:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.912294:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912299:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073bb39ee/0xce40b48e7cd2147f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912313:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912319:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912324:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912333:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081ef8057 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912335:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912341:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912348:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0xe7aaf970 (000000007a61c3bd) 00010000:00010000:1.0:1781281097.912350:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.912352:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912357:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081ef8057/0xce40b48e7cd21494 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912369:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912375:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912380:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912385:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000090c9d8d4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912386:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912391:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912399:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x379:0x0].0x0 (00000000b4bdc372) 00010000:00010000:1.0:1781281097.912401:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.912403:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912408:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000090c9d8d4/0xce40b48e7cd2149b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x379:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912424:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912429:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912434:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912439:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003e80f75c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.912441:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912446:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912453:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xcbe2ca0f (0000000050c21257) 00010000:00010000:1.0:1781281097.912456:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.912457:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.912467:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003e80f75c/0xce40b48e7cd214b0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.913174:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281097.913339:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778624 00000100:00100000:0.0:1781281097.913391:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778880 00000100:00100000:0.0:1781281097.913414:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:0.0:1781281097.913420:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3176:x1867808083778944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281097.913452:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:427 count 1 00010000:00010000:0.0:1781281097.913488:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.913520:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 73 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.913528:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.913530:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.913532:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 4/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.913581:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 73 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.913596:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.913609:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dacaadb4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14262:1867808083779392:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281097.913682:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e0151ac4 going to sleep for 43 seconds 00010000:00010000:1.0:1781281097.914036:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914044:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914050:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914129:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c3d59a5f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.914132:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914139:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914151:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x220:0x0].0x0 (00000000df751442) 00010000:00010000:1.0:1781281097.914153:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.914156:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914239:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c3d59a5f/0xce40b48e7cd214b7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914261:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914272:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914278:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914283:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067afaba8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.914285:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914291:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914300:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x10cfb8f0 (00000000d346c251) 00010000:00010000:1.0:1781281097.914302:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.914304:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914309:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067afaba8/0xce40b48e7cd214da lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914322:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914328:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914334:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914342:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c5a5990e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.914344:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914349:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914356:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21c:0x0].0x0 (0000000081cd5431) 00010000:00010000:1.0:1781281097.914358:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.914360:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914365:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c5a5990e/0xce40b48e7cd214e1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914381:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914387:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914392:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914398:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003ca58c5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.914400:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914405:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914413:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x8b6dba3a (00000000c5861570) 00010000:00010000:1.0:1781281097.914415:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.914417:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 2/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914421:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd214ef lrc: 0/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914432:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914437:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914442:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914447:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003af10635 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.914448:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914453:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914459:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x267:0x0].0x0 (00000000eee8b9d0) 00010000:00010000:1.0:1781281097.914461:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.914463:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.914480:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af10635/0xce40b48e7cd214f6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281097.914681:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083d3ef0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281097.917574:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083779328:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.917609:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281097.917654:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.917683:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805312 00010000:00010000:0.0:1781281097.917721:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 5/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.918047:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281097.918123:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4788 00000100:00100000:0.0:1781281097.918133:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2271:x1867808064805312:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1781281097.918149:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.918154:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 5/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.918251:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1781281097.918257:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011fa024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3176:x1867808083778624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281097.918283:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:225 count 1 00010000:00010000:2.0:1781281097.918306:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.918320:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 73 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.918327:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.918329:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.918331:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 4/0,1 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.918364:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 73 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.918374:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 73 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.918393:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb2284de pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083779456:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.918458:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 000000004333ba59 going to sleep for 43 seconds 00010000:00010000:0.0:1781281097.918591:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 4/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.918620:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.918622:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.918625:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.918632:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 4/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.918647:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.918668:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df5cee7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2271:x1867808064805312:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 536us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.918677:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4788 00000100:00100000:3.0:1781281097.918995:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083779264:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.919011:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.919034:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778176 00010000:00010000:1.0:1781281097.919138:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919146:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919152:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aac752a8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.919155:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.919279:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.919299:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.919322:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.919341:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.919379:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.919394:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805440 00010000:00010000:2.0:1781281097.919412:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 4/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 74 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.919429:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805248 00010000:00010000:2.0:1781281097.919438:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 5/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.919448:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805376 00010000:00010000:2.0:1781281097.919455:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 72 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.919466:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805504 00010000:00010000:2.0:1781281097.919486:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 5/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 73 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.919631:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919643:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x801dd473 (000000009bddd47c) 00010000:00010000:1.0:1781281097.919646:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.919649:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919655:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aac752a8/0xce40b48e7cd21504 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919673:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919683:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919688:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919693:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f94cdc55 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.919695:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919701:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919707:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x218:0x0].0x0 (0000000079049e0c) 00010000:00010000:1.0:1781281097.919709:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.919710:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919715:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f94cdc55/0xce40b48e7cd2150b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919734:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919740:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919745:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919754:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bd692838 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.919756:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919772:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919779:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x8d5ea5b7 (00000000ab645b08) 00010000:00010000:1.0:1781281097.919781:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.919783:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919789:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bd692838/0xce40b48e7cd21520 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919802:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919807:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919812:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919817:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000062ec7b3a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.919819:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919824:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919906:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x268:0x0].0x0 (00000000c3728c87) 00010000:00010000:1.0:1781281097.919909:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.919912:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919917:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062ec7b3a/0xce40b48e7cd21527 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919936:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919941:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919947:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919952:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000914c8080 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.919954:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919959:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919965:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0xe364b611 (000000003ba0ca5b) 00010000:00010000:1.0:1781281097.919968:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.919970:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919979:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000914c8080/0xce40b48e7cd21535 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919989:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.919995:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920000:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920005:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee3deb27 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920007:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920012:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920019:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x265:0x0].0x0 (00000000d4f02738) 00010000:00010000:1.0:1781281097.920020:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.920022:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920026:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee3deb27/0xce40b48e7cd2153c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920040:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920049:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920127:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920133:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000065b918e4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920134:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920140:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920148:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x1e0192a5 (00000000e894a040) 00010000:00010000:1.0:1781281097.920150:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.920152:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920157:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000065b918e4/0xce40b48e7cd2154a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920240:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920245:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920250:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920259:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e1fe846 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920261:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920266:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920273:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x216:0x0].0x0 (00000000661a8a60) 00010000:00010000:1.0:1781281097.920275:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.920277:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920282:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e1fe846/0xce40b48e7cd21551 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920298:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920303:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920308:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920314:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000021d63a49 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920316:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920322:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920329:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x9062bf83 (00000000c774349e) 00010000:00010000:1.0:1781281097.920331:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.920333:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920338:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021d63a49/0xce40b48e7cd21566 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920349:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920354:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920359:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920364:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000884f6405 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920365:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920370:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920377:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21e:0x0].0x0 (000000006d773b06) 00010000:00010000:1.0:1781281097.920380:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.920381:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920391:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000884f6405/0xce40b48e7cd2156d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920405:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920411:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920415:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920420:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bedcc5aa already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920422:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920426:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920433:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xbfd87aeb (00000000cbb1a944) 00010000:00010000:1.0:1781281097.920435:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.920437:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920442:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bedcc5aa/0xce40b48e7cd21582 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920451:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920461:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920466:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920471:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000008ce44f8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.920483:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.920488:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.920644:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805568 00010000:00010000:2.0:1781281097.920668:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 5/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 75 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.920694:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4789 00000100:00100000:2.0:1781281097.920699:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c11f9572 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+75:2271:x1867808064805440:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281097.920714:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281097.920719:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 4/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 75 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.920728:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 3/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 75 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.920747:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb77270/0xce40b48e7ccff860 lrc: 0/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff283 expref: 75 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.920757:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.920758:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.920761:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.920769:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 4/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.920800:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281097.920915:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c11f9572 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+74:2271:x1867808064805440:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 215us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281097.920923:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4789 00000100:00100000:2.0:1781281097.920939:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4790 00000100:00100000:2.0:1781281097.920942:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000affb6812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2271:x1867808064805248:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281097.920950:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281097.920954:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 5/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 73 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.920962:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 73 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.920975:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.920976:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.920978:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.920985:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 4/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.920995:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281097.921010:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000affb6812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2271:x1867808064805248:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 67us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281097.921016:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4790 00000100:00100000:2.0:1781281097.921028:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4791 00000100:00100000:2.0:1781281097.921032:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046e46d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+72:2271:x1867808064805376:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281097.921038:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281097.921042:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 72 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.921049:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 72 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.921262:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20c:0x0].0x0 (000000000a0092e4) 00010000:00010000:1.0:1781281097.921265:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.921269:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921275:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008ce44f8/0xce40b48e7cd21589 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921295:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921300:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921306:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921314:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026b7d855 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921317:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921322:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921329:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0xeff62052 (00000000c8b93baa) 00010000:00010000:1.0:1781281097.921331:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.921333:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921338:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026b7d855/0xce40b48e7cd2159e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921349:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921354:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921359:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921364:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af240689 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921366:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921370:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921377:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x227:0x0].0x0 (000000000d0af636) 00010000:00010000:1.0:1781281097.921379:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.921380:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921384:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af240689/0xce40b48e7cd215a5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921399:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921405:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921410:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921415:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b83e432 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921417:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921423:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921429:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xd60b5417 (00000000afec688e) 00010000:00010000:1.0:1781281097.921431:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.921433:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921443:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b83e432/0xce40b48e7cd215ba lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921456:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921461:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921466:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921471:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f9e3574b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921483:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921489:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921504:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x214:0x0].0x0 (000000000fe3bb58) 00010000:00010000:1.0:1781281097.921506:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.921508:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921513:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9e3574b/0xce40b48e7cd215c1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921528:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921538:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921557:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921561:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000442702b0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921563:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921568:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921575:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x1e68dc46 (0000000010c8e62e) 00010000:00010000:1.0:1781281097.921577:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.921579:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921584:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000442702b0/0xce40b48e7cd215d6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921595:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921601:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921606:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921615:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000303fe0d6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921617:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921623:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921629:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x229:0x0].0x0 (00000000081f9a93) 00010000:00010000:1.0:1781281097.921631:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.921633:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921638:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000303fe0d6/0xce40b48e7cd215dd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921650:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921656:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921661:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921666:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008e62497b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921668:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921673:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921680:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xee1a16ec (000000002fb6f147) 00010000:00010000:1.0:1781281097.921683:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.921684:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921689:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008e62497b/0xce40b48e7cd215f2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921700:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921705:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921711:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921716:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000013a01197 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921717:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921722:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921728:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21a:0x0].0x0 (00000000baa0939e) 00010000:00010000:1.0:1781281097.921730:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.921731:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921740:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013a01197/0xce40b48e7cd215f9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921754:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921769:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921775:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921781:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d023120b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.921783:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921788:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921795:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0xdf197568 (0000000077ccf02a) 00010000:00010000:1.0:1781281097.921797:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.921799:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921804:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d023120b/0xce40b48e7cd2160e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921815:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.921824:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.921942:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1781281097.921949:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+9:3176:x1867808083778880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.921972:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:257 count 1 00010000:00010000:3.0:1781281097.921992:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.922005:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 73 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.922011:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.922014:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.922015:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 4/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.922045:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 73 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.922067:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 73 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.922081:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083779520:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.922126:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 00000000acb0b455 going to sleep for 43 seconds 00010000:00010000:2.0:1781281097.922324:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065be7b9a/0xce40b48e7ccff629 lrc: 0/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff18e expref: 72 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.922333:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922335:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922336:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922343:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 4/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922366:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281097.922387:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046e46d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2271:x1867808064805376:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 1354us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281097.922395:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4791 00000100:00100000:2.0:1781281097.922437:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4792 00000100:00100000:2.0:1781281097.922442:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ab95811 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+70:2269:x1867808064805504:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281097.922451:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281097.922455:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 5/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 70 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.922463:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 4/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 70 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.922486:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922488:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922490:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922496:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 4/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922509:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281097.922525:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ab95811 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+70:2269:x1867808064805504:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 83us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281097.922531:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4792 00000100:00100000:2.0:1781281097.922558:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4793 00000100:00100000:2.0:1781281097.922563:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a16d7521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2271:x1867808064805568:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281097.922570:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281097.922574:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 5/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.922581:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281097.922594:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922595:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281097.922597:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922603:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 4/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922614:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281097.922630:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a16d7521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2271:x1867808064805568:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 67us (3252us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281097.922636:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4793 00010000:00010000:2.0:1781281097.922664:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922671:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922678:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922683:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.922699:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1781281097.923406:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923414:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d3d086ca already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923418:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923425:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923437:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22b:0x0].0x0 (00000000d50558db) 00010000:00010000:1.0:1781281097.923439:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.923442:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923447:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d3d086ca/0xce40b48e7cd21615 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923469:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923487:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923492:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923500:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000070eca35f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923502:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923507:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923515:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x5a3b2e4f (000000001dc229fe) 00010000:00010000:1.0:1781281097.923517:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.923518:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923524:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000070eca35f/0xce40b48e7cd21646 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923535:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923554:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923559:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923565:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003ac11116 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923566:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923570:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923577:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x210:0x0].0x0 (00000000ecaa9965) 00010000:00010000:1.0:1781281097.923579:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.923580:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923585:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003ac11116/0xce40b48e7cd2164d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923602:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923608:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923612:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923617:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000395b06e4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923618:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923623:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923630:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xb65fef2a (00000000649ca2ab) 00010000:00010000:1.0:1781281097.923632:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.923633:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923642:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000395b06e4/0xce40b48e7cd21662 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923654:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923659:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923663:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923668:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003be258ea already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923670:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923674:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923680:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20e:0x0].0x0 (00000000410379d0) 00010000:00010000:1.0:1781281097.923681:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.923683:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923688:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003be258ea/0xce40b48e7cd21669 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923704:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923713:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923718:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923724:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000038607c44 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923726:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923731:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923739:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x204a7f30 (0000000027c0c36c) 00010000:00010000:1.0:1781281097.923741:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.923744:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923748:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038607c44/0xce40b48e7cd2167e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923759:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923764:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923769:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923778:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003d9d0481 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.923780:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923786:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923792:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fe:0x0].0x0 (000000002499e313) 00010000:00010000:1.0:1781281097.923794:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.923796:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923801:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003d9d0481/0xce40b48e7cd21685 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923816:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.923821:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.924285:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008362d394 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3176:x1867808083778304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25685us (26903us total) trans 4294968304 rc 0/0 00000100:00100000:2.0:1781281097.924295:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1781281097.924319:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1781281097.924324:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3177:x1867808083778176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281097.924348:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:226 count 1 00010000:00010000:2.0:1781281097.924366:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924380:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 69 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924392:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.924394:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.924395:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 4/0,1 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924423:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 3/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 69 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924433:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 4/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.924445:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c11f9572 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083779584:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.924496:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 0000000085896c47 going to sleep for 43 seconds 00010000:00010000:2.0:1781281097.924515:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281097.924520:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924526:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009f6dc9ac already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.924529:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924535:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924565:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 1/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924576:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f6dc9ac/0xce40b48e7cd2240e lrc: 0/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924593:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.924594:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.924595:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.924606:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924614:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924620:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924626:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.924640:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1781281097.924910:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924917:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000715d609c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.924919:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924925:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924935:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0xc5f130b7 (000000003cfe86b1) 00010000:00010000:1.0:1781281097.924937:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.924939:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924945:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000715d609c/0xce40b48e7cd216a8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924959:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924963:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924968:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924972:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f89b0034 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.924974:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924980:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.924986:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x212:0x0].0x0 (00000000c6938ba4) 00010000:00010000:1.0:1781281097.924988:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.924990:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925000:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f89b0034/0xce40b48e7cd216b6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925017:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925022:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925027:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925032:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008316af2d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925034:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925040:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925047:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0xf786fdb3 (00000000ce5e61ac) 00010000:00010000:1.0:1781281097.925049:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.925051:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925346:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008316af2d/0xce40b48e7cd216a1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925360:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925370:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925376:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925381:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad42ebfa already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925382:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925387:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925395:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fc:0x0].0x0 (000000007954595b) 00010000:00010000:1.0:1781281097.925397:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.925399:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925405:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad42ebfa/0xce40b48e7cd216af lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925420:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925425:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925430:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925440:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000031fc7532 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925442:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925446:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925452:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x8d5ea5b7 (000000001bab2cea) 00010000:00010000:1.0:1781281097.925454:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.925456:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925461:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000031fc7532/0xce40b48e7cd216e0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925487:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925494:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925498:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925503:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005cbf39e1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925505:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925509:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925516:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x266:0x0].0x0 (00000000f461ce22) 00010000:00010000:1.0:1781281097.925518:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.925520:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925525:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005cbf39e1/0xce40b48e7cd216e7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925537:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925561:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925567:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925572:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006723bd34 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925574:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925579:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925586:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x283705e2 (00000000566a0164) 00010000:00010000:1.0:1781281097.925588:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.925590:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925598:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006723bd34/0xce40b48e7cd216f5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925609:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925615:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925621:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925625:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ae054bb5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925627:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925631:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925637:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a0:0x0].0x0 (0000000028c7e7bb) 00010000:00010000:1.0:1781281097.925639:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.925641:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 2/0,0 mode: --/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925645:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae054bb5/0xce40b48e7cd216fc lrc: 0/0,0 mode: --/COS res: [0x200000402:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925658:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925668:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925674:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925679:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000040d91bad already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925680:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925685:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925692:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0xe364b611 (0000000087de360d) 00010000:00010000:1.0:1781281097.925694:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.925696:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925700:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000040d91bad/0xce40b48e7cd21711 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925709:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925714:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925719:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925727:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6383283 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.925729:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925734:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925741:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x262:0x0].0x0 (00000000bb974c6b) 00010000:00010000:1.0:1781281097.925743:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.925745:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.925749:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6383283/0xce40b48e7cd21718 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926331:0:14262:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440e18ce/0xce40b48e7cd1c024 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08a45 expref: 72 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.926347:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dacaadb4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14262:1867808083779392:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.926367:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926375:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926381:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926388:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926394:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.926414:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1781281097.927169:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927180:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927184:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927189:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000085b35891 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927192:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927198:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927210:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xb0449b87 (00000000aea86f9e) 00010000:00010000:1.0:1781281097.927212:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927214:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927219:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000085b35891/0xce40b48e7cd2172d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927232:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927237:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927241:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927245:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000928a26ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927247:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927251:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927256:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x392:0x0].0x0 (000000008312843f) 00010000:00010000:1.0:1781281097.927258:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927259:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927268:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000928a26ce/0xce40b48e7cd21734 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927279:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927284:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927288:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927292:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000362e76ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927294:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927297:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927302:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x8b6dba3a (00000000c026c2d1) 00010000:00010000:1.0:1781281097.927304:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927305:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927310:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000362e76ce/0xce40b48e7cd21749 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927320:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927328:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927333:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927337:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000983ae23 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927338:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927342:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927347:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x264:0x0].0x0 (000000003ffba7e5) 00010000:00010000:1.0:1781281097.927349:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927350:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927355:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000983ae23/0xce40b48e7cd21750 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927368:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927373:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927377:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927385:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007616d0ce already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927386:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927390:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927395:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x98ca20bd (00000000cd877e7d) 00010000:00010000:1.0:1781281097.927397:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927398:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927403:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007616d0ce/0xce40b48e7cd21765 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927413:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927419:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927424:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927429:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073e3cde8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927431:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927436:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927443:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x255:0x0].0x0 (00000000f45622b2) 00010000:00010000:1.0:1781281097.927445:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927447:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927451:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073e3cde8/0xce40b48e7cd2176c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927465:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927470:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927485:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927490:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000458e3961 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927492:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927497:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927503:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x14be06ab (00000000a86c7917) 00010000:00010000:1.0:1781281097.927505:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927506:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927515:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000458e3961/0xce40b48e7cd2179d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927526:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927530:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927535:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927539:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000df038d74 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927554:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927559:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927565:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22c:0x0].0x0 (0000000016e87ae1) 00010000:00010000:1.0:1781281097.927567:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927569:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927574:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000df038d74/0xce40b48e7cd217a4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927588:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927598:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927604:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927609:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005e694475 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927611:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927615:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927622:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xf2061246 (00000000901d93ec) 00010000:00010000:1.0:1781281097.927624:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927625:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927631:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005e694475/0xce40b48e7cd21781 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927641:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927646:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927651:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927660:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dbd1374 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927661:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927666:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927672:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x251:0x0].0x0 (0000000075b742c1) 00010000:00010000:1.0:1781281097.927674:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927676:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927681:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dbd1374/0xce40b48e7cd21788 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927694:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927698:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927702:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927706:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007467a8a1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927708:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927713:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927720:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xbcf75103 (00000000ee546b8d) 00010000:00010000:1.0:1781281097.927722:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927724:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927729:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007467a8a1/0xce40b48e7cd217c7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927740:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927745:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927750:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927755:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ab15b2ab already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927757:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927774:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927781:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x253:0x0].0x0 (00000000dbaaf69f) 00010000:00010000:1.0:1781281097.927783:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927785:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 2/0,0 mode: --/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927794:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ab15b2ab/0xce40b48e7cd217ce lrc: 0/0,0 mode: --/COS res: [0x200000402:0x253:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927808:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927814:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927819:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927825:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bf0a55b3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927826:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927840:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927847:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x77103a66 (0000000013cefdc8) 00010000:00010000:1.0:1781281097.927849:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927851:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927856:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bf0a55b3/0xce40b48e7cd217c0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927866:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927876:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927882:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927887:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000491ef023 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927889:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927894:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927901:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22e:0x0].0x0 (000000002033747b) 00010000:00010000:1.0:1781281097.927903:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.927904:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927910:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000491ef023/0xce40b48e7cd217d5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927927:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927932:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927937:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927947:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5242b65 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927949:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927955:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927961:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xca0b3ea (000000000ef68632) 00010000:00010000:1.0:1781281097.927963:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.927964:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927970:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5242b65/0xce40b48e7cd217f1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927979:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927984:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927989:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.927994:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e78eaf7c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.927996:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928003:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928010:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23b:0x0].0x0 (000000000a2880eb) 00010000:00010000:1.0:1781281097.928012:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.928014:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928019:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e78eaf7c/0xce40b48e7cd217f8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928032:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928037:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928042:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.928047:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000008eb17f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.928049:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.928404:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ce960b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3176:x1867808083778688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27155us (29656us total) trans 4294968062 rc 0/0 00000100:00100000:2.0:1781281097.928416:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00010000:00010000:2.0:1781281097.928456:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281097.928461:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928470:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092624ffc already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.928483:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928490:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 3/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928516:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 1/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928521:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092624ffc/0xce40b48e7cd22415 lrc: 0/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928537:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281097.928539:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928558:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a234b52 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.928560:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928565:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928573:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928578:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a234b52/0xce40b48e7cd2241c lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.928592:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.928594:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.928595:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1781281097.928648:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000024d058b5/2, rc 0, transno 766 00000100:00100000:2.0:1781281097.928667:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024d058b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778688:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1781281097.928677:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000065093734/2, rc 0, transno 765 00000100:00100000:2.0:1781281097.928680:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065093734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.928692:0:3176:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968303 gen 2 00000004:00080000:2.0:1781281097.928697:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002252d9c7, transno 4294968294 00000004:00080000:2.0:1781281097.928709:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000005f2ddc48, transno 4294968295 00000004:00080000:2.0:1781281097.928711:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000083830b2d, transno 4294968296 00000004:00080000:2.0:1781281097.928714:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009db642b7, transno 4294968301 00000004:00080000:2.0:1781281097.928716:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000398b4a41, transno 4294968302 00000004:00080000:2.0:1781281097.928718:0:3176:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000052409705, transno 4294968303 00000100:00100000:2.0:1781281097.928723:0:3176:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@0000000004f49510 x1867808083778304/t4294968304(4294968304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1781281141 ref 2 fl Rpc:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000004:00080000:2.0:1781281097.928730:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000004f49510/2, rc 0, transno 1008 00000100:00100000:2.0:1781281097.928733:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004f49510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281097.928930:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000affb6812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083779648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.928974:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.928996:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1781281097.929001:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5058fa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083779712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.929021:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.929050:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083779648 00000100:00100000:2.0:1781281097.929243:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083779712 00000100:00100000:2.0:1781281097.929263:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1781281097.929269:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065fc3517 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3175:x1867808083779648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281097.929291:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:250 count 1 00010000:00010000:2.0:1781281097.929311:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.929327:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 71 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.929335:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.929337:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.929339:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 4/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.929364:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 71 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.929375:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 71 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.929385:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083779776:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.929415:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 00000000765d2e5d going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.930330:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1781281097.930336:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c9fe8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3175:x1867808083779712:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.930376:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.930402:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012218d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.930435:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.930450:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d27c9c17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778816:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.930469:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.930492:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3dbdb4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083779072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.930515:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.930560:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778240 00000100:00100000:3.0:1781281097.930583:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778496 00000100:00100000:3.0:1781281097.930594:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778816 00000100:00100000:3.0:1781281097.930609:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083779072 00000100:00100000:3.0:1781281097.930623:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1781281097.930627:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d34b60a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083778240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.930648:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:227 count 1 00010000:00010000:3.0:1781281097.930670:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.930686:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 69 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.930693:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.930695:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.930697:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 4/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.930721:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 69 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.930730:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 69 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.930740:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083779840:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.930785:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d811a519 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.930802:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1781281097.930806:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d6b34d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3178:x1867808083778496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.930819:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:232 count 1 00010000:00010000:3.0:1781281097.931073:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931086:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 69 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931096:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931097:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931099:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 4/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931118:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 69 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931126:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.931134:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f1e1dd4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083779904:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.931291:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 0000000016e5a8b5 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.931311:0:7754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1781281097.931315:0:7754:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001483d93 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3178:x1867808083778816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.931329:0:7754:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:425 count 1 00010000:00010000:3.0:1781281097.931343:0:7754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931355:0:7754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 71 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931361:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931363:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931364:0:7754:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 4/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931388:0:7754:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 71 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931395:0:7754:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 71 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.931403:0:7754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b1addb pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083779968:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.931425:0:7754:0:(client.c:2500:ptlrpc_set_wait()) set 0000000077b3b4d4 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.931441:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1781281097.931445:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c3ba4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3178:x1867808083779072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.931456:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:249 count 1 00010000:00010000:3.0:1781281097.931465:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931486:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 71 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931492:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931494:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.931495:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 4/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931512:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 71 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931519:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 71 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.931529:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083780032:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.931569:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fd28ddff going to sleep for 43 seconds 00010000:00010000:3.0:1781281097.931612:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7ccff87c lrc: 0/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff291 expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.931625:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008544c56b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083779200:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.931646:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931654:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931660:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931667:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,1 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931673:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.931693:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281097.932627:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000398f68c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3176:x1867808083778048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34195us (35277us total) trans 4294968305 rc 0/0 00000100:00100000:3.0:1781281097.932638:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00010000:00010000:3.0:1781281097.932668:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.932673:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932682:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003a03766 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.932685:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 2/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932693:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 3/0,0 mode: PW/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932710:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 1/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932716:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a03766/0xce40b48e7cd22407 lrc: 0/0,0 mode: --/PW res: [0xe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932735:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.932736:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.932737:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.932774:0:14261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca60395a/0xce40b48e7ccffb0e lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff37f expref: 68 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.932784:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f1a637c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083779136:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.932799:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932806:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932813:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932819:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.932824:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.936371:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1781281097.936936:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009dfc4c63/2, rc 0, transno 1009 00000100:00100000:2.0:1781281097.936948:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009dfc4c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281097.937306:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3176:x1867808083778944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23883us (36304us total) trans 4294968061 rc 0/0 00000100:00100000:0.0:1781281097.937319:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00010000:00010000:0.0:1781281097.937354:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281097.937361:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.937371:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007abec6b7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281097.937374:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.937383:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.937404:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 1/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.937410:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007abec6b7/0xce40b48e7cd22400 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.937432:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281097.937434:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281097.937435:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281097.938092:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3176:x1867808083778368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40355us (40787us total) trans 4294968306 rc 0/0 00000100:00100000:3.0:1781281097.938101:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00010000:00010000:3.0:1781281097.938120:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00100000:3.0:1781281097.938178:0:9052:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 6 records, first 384 in log [0x6:0x1:0x0] 00000004:00080000:3.0:1781281097.938295:0:9052:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 58 changes, 8 in progress, 6 in flight, 6 done 00010000:00010000:3.0:1781281097.938380:0:14278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000547153ab/0xce40b48e7ccff940 lrc: 0/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2e5 expref: 67 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.938393:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083778560:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.938410:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.938419:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.938432:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.938439:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.938445:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.938460:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281097.938702:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008544c56b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281097.938743:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281097.938779:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1781281097.938785:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f1a637c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281097.938806:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281097.938851:0:14239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780160 00000100:00100000:0.0:1781281097.938880:0:14239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780096 00000100:00100000:0.0:1781281097.938897:0:14239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:0.0:1781281097.938902:0:14239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d81cd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3178:x1867808083780160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1781281097.938926:0:14239:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:262 count 1 00010000:00010000:0.0:1781281097.938947:0:14239:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.938961:0:14239:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.938969:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.938971:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.938987:0:14239:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 4/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939015:0:14239:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939027:0:14239:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.939037:0:14239:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083780224:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281097.939800:0:14239:0:(client.c:2500:ptlrpc_set_wait()) set 000000007b87d8b9 going to sleep for 43 seconds 00000100:00100000:0.0:1781281097.939828:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:0.0:1781281097.939834:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3178:x1867808083780096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1781281097.939852:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:263 count 1 00010000:00010000:0.0:1781281097.939866:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939879:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939885:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.939886:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.939888:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 4/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939930:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.939938:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.939948:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075f4167c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083780288:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281097.939972:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5b990ca going to sleep for 43 seconds 00010000:00010000:1.0:1781281097.940196:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940214:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0xc4fc354d (000000001d112f30) 00010000:00010000:1.0:1781281097.940217:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940221:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940232:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000008eb17f/0xce40b48e7cd2180d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940254:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940261:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940267:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940272:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006ff2082a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940275:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940280:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940287:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x230:0x0].0x0 (0000000029006562) 00010000:00010000:1.0:1781281097.940288:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.940291:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940296:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006ff2082a/0xce40b48e7cd21814 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940320:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940332:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940337:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940342:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000959bd900 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940344:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940348:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940355:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x8ee21578 (000000009c26cfbf) 00010000:00010000:1.0:1781281097.940357:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940359:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940364:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000959bd900/0xce40b48e7cd21829 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940377:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940382:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940387:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940395:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009314175e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940397:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940402:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940409:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39f:0x0].0x0 (0000000081e11052) 00010000:00010000:1.0:1781281097.940411:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.940413:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940418:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009314175e/0xce40b48e7cd21830 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940431:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940437:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940442:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940447:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da730b65 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940449:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940454:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940461:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x21e72734 (00000000b4f3e15e) 00010000:00010000:1.0:1781281097.940463:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940465:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940470:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000da730b65/0xce40b48e7cd21845 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940491:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940495:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940500:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940505:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f50b7ef4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940507:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940512:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940518:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25c:0x0].0x0 (00000000e72377ba) 00010000:00010000:1.0:1781281097.940520:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.940521:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940531:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f50b7ef4/0xce40b48e7cd2184c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940716:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940723:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940728:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940734:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a1c493c7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940736:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940741:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940748:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xc3f00931 (00000000b66dfa7e) 00010000:00010000:1.0:1781281097.940750:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940752:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940763:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd21861 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940774:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940784:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940790:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940795:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceac6799 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940796:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940801:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940809:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x243:0x0].0x0 (000000002ba2d389) 00010000:00010000:1.0:1781281097.940811:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.940813:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940818:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceac6799/0xce40b48e7cd21868 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940832:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940838:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940842:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940851:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000847b6010 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940853:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940859:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940866:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xe5dc7a0b (00000000f8b7c99c) 00010000:00010000:1.0:1781281097.940868:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940869:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940875:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000847b6010/0xce40b48e7cd2187d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940889:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940895:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940900:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940904:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000055ce1472 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940906:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940911:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940918:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x203:0x0].0x0 (00000000eac9b33f) 00010000:00010000:1.0:1781281097.940920:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.940921:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940927:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000055ce1472/0xce40b48e7cd21884 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940943:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940949:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940954:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940959:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069b7952d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.940960:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940965:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940972:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x6428115e (0000000087bbeef9) 00010000:00010000:1.0:1781281097.940973:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.940975:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940983:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069b7952d/0xce40b48e7cd218ae lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.940995:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941000:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941004:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941009:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009b0cc02e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941010:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941016:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941022:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x201:0x0].0x0 (00000000bf2801e2) 00010000:00010000:1.0:1781281097.941024:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941026:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941030:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009b0cc02e/0xce40b48e7cd218b5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941045:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941055:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941059:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941064:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a51408a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941066:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941071:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941078:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x3afecd66 (0000000080ba8a78) 00010000:00010000:1.0:1781281097.941081:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941083:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941088:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a51408a/0xce40b48e7cd21899 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941099:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941104:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941108:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941117:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ea6efce0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941118:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941123:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941130:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x257:0x0].0x0 (0000000025c4d843) 00010000:00010000:1.0:1781281097.941132:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941134:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941139:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea6efce0/0xce40b48e7cd218a0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941151:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941157:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941161:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941166:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aaa5c9f9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941167:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941172:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941180:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xf4ed591 (00000000558ed917) 00010000:00010000:1.0:1781281097.941182:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941183:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941188:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aaa5c9f9/0xce40b48e7cd218d1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941199:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941204:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941209:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941213:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d874006 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941214:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941219:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941225:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x205:0x0].0x0 (00000000d6b1f872) 00010000:00010000:1.0:1781281097.941227:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941228:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941237:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d874006/0xce40b48e7cd218d8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941250:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941256:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941261:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941266:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba610bd5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941268:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941273:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941279:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xcd7d97c8 (00000000b5a4d672) 00010000:00010000:1.0:1781281097.941281:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941283:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941287:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba610bd5/0xce40b48e7cd218ed lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941302:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941310:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941315:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941320:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006560a1a0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941322:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941327:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941333:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x237:0x0].0x0 (00000000295e57e7) 00010000:00010000:1.0:1781281097.941335:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941337:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941342:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006560a1a0/0xce40b48e7cd218f4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941355:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941361:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941367:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941374:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a5dac709 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941377:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941381:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941388:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x103f9c81 (0000000031a80ae1) 00010000:00010000:1.0:1781281097.941390:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941392:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941397:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5dac709/0xce40b48e7cd21909 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941409:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941415:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941420:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941425:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d1c3eb5c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941427:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941432:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941439:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x245:0x0].0x0 (0000000063efd5b7) 00010000:00010000:1.0:1781281097.941441:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941443:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941448:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1c3eb5c/0xce40b48e7cd21910 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941461:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941466:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941483:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941489:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005b955b3b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941491:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941496:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941503:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x469e1765 (00000000add04949) 00010000:00010000:1.0:1781281097.941504:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941506:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941516:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b955b3b/0xce40b48e7cd21925 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941525:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941530:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941535:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941562:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000031b8b1eb already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941564:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941569:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941576:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x207:0x0].0x0 (000000002a0f5a3f) 00010000:00010000:1.0:1781281097.941578:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941580:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941585:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000031b8b1eb/0xce40b48e7cd2192c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941598:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941607:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941612:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941616:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d0d9c9e1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941618:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941623:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941630:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x17d46a (00000000eb2ae7d4) 00010000:00010000:1.0:1781281097.941632:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941634:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941640:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0d9c9e1/0xce40b48e7cd2195d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941650:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941654:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941658:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941665:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026f7797d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941667:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941671:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941676:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x241:0x0].0x0 (0000000028d567f6) 00010000:00010000:1.0:1781281097.941677:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941679:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941683:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026f7797d/0xce40b48e7cd21964 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941693:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941698:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941702:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941706:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e81b4b8d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941707:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941711:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941719:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xc3d50206 (00000000de116828) 00010000:00010000:1.0:1781281097.941721:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941723:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941727:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e81b4b8d/0xce40b48e7cd21941 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941737:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941742:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941747:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941751:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004ad6e7a8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941753:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941757:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941764:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x209:0x0].0x0 (000000006694c32b) 00010000:00010000:1.0:1781281097.941766:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941767:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941776:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004ad6e7a8/0xce40b48e7cd21948 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941793:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941799:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941804:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941808:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001dc6863d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941810:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941814:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941820:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xa5e17578 (00000000b93e23e5) 00010000:00010000:1.0:1781281097.941822:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941823:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941828:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001dc6863d/0xce40b48e7cd21979 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941838:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941847:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941851:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941856:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c064e1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941859:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941864:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941870:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23d:0x0].0x0 (00000000174a3c69) 00010000:00010000:1.0:1781281097.941872:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941874:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941878:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c064e1/0xce40b48e7cd21980 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941893:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941899:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941904:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941912:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007da12b70 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941914:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941919:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941925:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xe7aaf970 (00000000fd773de5) 00010000:00010000:1.0:1781281097.941927:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.941929:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941934:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007da12b70/0xce40b48e7cd21995 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941945:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941951:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941955:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941960:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000294e515 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.941962:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941966:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941973:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x376:0x0].0x0 (000000006f7f2ef2) 00010000:00010000:1.0:1781281097.941976:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.941978:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941983:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000294e515/0xce40b48e7cd2199c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.941997:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942003:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942008:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942013:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000afc6cb82 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942015:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942020:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942027:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x76821429 (000000001587c8f4) 00010000:00010000:1.0:1781281097.942029:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942031:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942039:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000afc6cb82/0xce40b48e7cd219b1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942050:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942055:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942061:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942065:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026aa2214 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942067:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942073:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942079:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24d:0x0].0x0 (00000000e662b1dc) 00010000:00010000:1.0:1781281097.942081:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942083:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942088:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000026aa2214/0xce40b48e7cd219b8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942102:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942111:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942116:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942122:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ae6f74b0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942124:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942129:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942135:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0xa36e7a4 (000000004c9c5422) 00010000:00010000:1.0:1781281097.942138:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942139:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942145:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae6f74b0/0xce40b48e7cd219cd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942156:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942162:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942167:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942176:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034e1a575 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942178:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942183:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942189:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36a:0x0].0x0 (0000000085352b7c) 00010000:00010000:1.0:1781281097.942191:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942193:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942198:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034e1a575/0xce40b48e7cd219d4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x36a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942210:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942215:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942220:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942225:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000d856c76 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942227:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942232:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942238:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x9e362f1b (000000007b067406) 00010000:00010000:1.0:1781281097.942240:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942242:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942246:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000d856c76/0xce40b48e7cd219e9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942257:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942262:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942267:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942271:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009068f16a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942273:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942278:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942284:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24f:0x0].0x0 (0000000011107ce7) 00010000:00010000:1.0:1781281097.942286:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942287:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942296:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009068f16a/0xce40b48e7cd219f0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942307:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942312:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942318:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942323:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d2e223b3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942324:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942330:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942335:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x6324417e (000000007a49b75b) 00010000:00010000:1.0:1781281097.942337:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942339:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942343:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e223b3/0xce40b48e7cd21a13 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942352:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942361:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942366:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942371:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc6c2a88 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942372:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942377:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942382:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24b:0x0].0x0 (000000007222a54c) 00010000:00010000:1.0:1781281097.942384:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942385:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942390:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc6c2a88/0xce40b48e7cd21a1a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942400:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942406:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942411:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942420:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c84ea5a8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942422:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942426:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942432:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0xdf197568 (0000000017993610) 00010000:00010000:1.0:1781281097.942434:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942435:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942440:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c84ea5a8/0xce40b48e7cd21a28 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942449:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942454:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942458:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942463:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000068d61262 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942464:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942470:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942490:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x228:0x0].0x0 (00000000415a95b5) 00010000:00010000:1.0:1781281097.942492:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942494:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942499:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000068d61262/0xce40b48e7cd21a2f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942511:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942516:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942521:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942526:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003b5bd8bf already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942528:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942533:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942539:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xbea011c (00000000db6a744d) 00010000:00010000:1.0:1781281097.942561:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942563:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942572:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003b5bd8bf/0xce40b48e7cd21a44 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942583:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942588:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942593:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942598:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099b5922c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942600:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942604:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942610:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x259:0x0].0x0 (0000000025f0778e) 00010000:00010000:1.0:1781281097.942612:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942613:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942618:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099b5922c/0xce40b48e7cd21a4b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942632:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942642:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942647:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942651:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e8d04897 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942653:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942658:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942663:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x1e68dc46 (00000000d45dc03d) 00010000:00010000:1.0:1781281097.942665:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942666:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942671:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8d04897/0xce40b48e7cd21a60 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942679:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942684:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942690:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942698:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009907c02d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942700:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942705:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942712:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x226:0x0].0x0 (000000009aa26873) 00010000:00010000:1.0:1781281097.942714:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942715:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942720:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009907c02d/0xce40b48e7cd21a67 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942733:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942738:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942743:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942748:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005eb14e97 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942749:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942754:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942761:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x51a4c572 (00000000c07fd348) 00010000:00010000:1.0:1781281097.942763:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942764:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942769:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005eb14e97/0xce40b48e7cd21a7c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942780:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942785:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942790:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942795:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f5551865 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942796:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942801:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942807:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x249:0x0].0x0 (00000000a9f50468) 00010000:00010000:1.0:1781281097.942808:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942810:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942819:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f5551865/0xce40b48e7cd21a83 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942830:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942835:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942841:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942846:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081649604 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942848:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942853:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942859:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0xeff62052 (00000000e4c0c214) 00010000:00010000:1.0:1781281097.942860:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942862:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942867:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081649604/0xce40b48e7cd21a98 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942877:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942886:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942891:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942896:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000083d6ff3a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942897:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942902:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942907:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x224:0x0].0x0 (000000006f6a69a2) 00010000:00010000:1.0:1781281097.942909:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.942910:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942915:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000083d6ff3a/0xce40b48e7cd21a9f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942926:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942931:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942935:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942945:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000066721723 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942946:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942951:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942957:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x2ee4e5f8 (00000000daea2188) 00010000:00010000:1.0:1781281097.942959:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.942960:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942964:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066721723/0xce40b48e7cd21ab4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942974:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942979:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942983:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942988:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b38a107c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.942989:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.942995:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943001:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x247:0x0].0x0 (00000000a03c5ba5) 00010000:00010000:1.0:1781281097.943004:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.943005:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 2/0,0 mode: --/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943009:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b38a107c/0xce40b48e7cd21abb lrc: 0/0,0 mode: --/COS res: [0x200000402:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943043:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943051:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943056:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943060:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082ac3c99 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943062:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943067:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943075:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0xa3962d5b (00000000758c336a) 00010000:00010000:1.0:1781281097.943076:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.943078:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943088:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082ac3c99/0xce40b48e7cd21b24 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943100:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943105:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943110:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943115:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000412085e0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943117:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943121:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943127:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25b:0x0].0x0 (00000000bebabaf2) 00010000:00010000:1.0:1781281097.943129:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.943130:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943134:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000412085e0/0xce40b48e7cd21b2b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943145:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943154:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943160:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943164:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009743fedf already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943165:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943170:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943176:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0xf786fdb3 (00000000631a4656) 00010000:00010000:1.0:1781281097.943178:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.943179:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943183:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009743fedf/0xce40b48e7cd21b40 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943193:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943197:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943202:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943211:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000336d73d8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943213:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943218:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943223:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fb:0x0].0x0 (0000000090c37552) 00010000:00010000:1.0:1781281097.943225:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.943226:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943230:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000336d73d8/0xce40b48e7cd21b47 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943241:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943246:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943251:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943256:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a346308b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943257:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943263:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943269:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x1674e29a (00000000d3edfa01) 00010000:00010000:1.0:1781281097.943271:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.943273:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943277:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a346308b/0xce40b48e7cd21b5c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943287:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943291:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943296:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943301:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000031bf4a2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943302:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943307:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943313:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23f:0x0].0x0 (0000000066f5f2ee) 00010000:00010000:1.0:1781281097.943315:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.943316:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943325:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000031bf4a2/0xce40b48e7cd21b63 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943337:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943342:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943346:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943351:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000520904e5 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943352:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943357:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943363:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x7ee78a8d (0000000083867f3d) 00010000:00010000:1.0:1781281097.943364:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.943366:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943371:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000520904e5/0xce40b48e7cd21b78 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x7ee78a8d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943380:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943389:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943394:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943399:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bf7aeafe already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943400:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943405:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943410:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3af:0x0].0x0 (00000000c861d00c) 00010000:00010000:1.0:1781281097.943412:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.943413:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943418:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bf7aeafe/0xce40b48e7cd21b7f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x3af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943430:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943434:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943439:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943448:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ac7b77b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.943450:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943455:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943460:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x204a7f30 (00000000824a8c95) 00010000:00010000:1.0:1781281097.943462:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.943463:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.943468:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ac7b77b/0xce40b48e7cd21b8d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.944505:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3176:x1867808083778112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46992us (47250us total) trans 4294968307 rc 0/0 00000100:00100000:3.0:1781281097.944517:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00010000:00010000:3.0:1781281097.944566:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.944571:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944580:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001aa99184 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.944583:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944590:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 3/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944607:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 1/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944617:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa99184/0xce40b48e7cd223f9 lrc: 0/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944633:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.944634:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.944635:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281097.944657:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b758d73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.944689:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.944712:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df937771 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.944728:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.944749:0:14266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778432 00000100:00100000:3.0:1781281097.944780:0:14266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083778752 00000100:00100000:3.0:1781281097.944793:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1781281097.944797:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3177:x1867808083778432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.944821:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:231 count 1 00010000:00010000:3.0:1781281097.944838:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944854:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 66 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944861:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.944863:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.944865:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 4/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944890:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 66 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944900:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 66 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.944910:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083780352:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.944947:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 0000000059b9fe73 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.944961:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1781281097.944964:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3177:x1867808083778752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.944975:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:422 count 1 00010000:00010000:3.0:1781281097.944986:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.944995:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 71 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945001:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945002:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945003:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 4/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945017:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 71 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945024:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 71 pid: 14240 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.945033:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d648dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083780416:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.945052:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 000000005cb1b3c4 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.945064:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a56045fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083779008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.945081:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.945107:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083779008 00000100:00100000:3.0:1781281097.945121:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:3.0:1781281097.945124:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+15:3177:x1867808083779008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.945132:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:435 count 1 00010000:00010000:3.0:1781281097.945141:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945149:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 71 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945155:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945157:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945158:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 4/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945171:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 71 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945177:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 4/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 71 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.945185:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14278:1867808083780480:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.945202:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 0000000099998adb going to sleep for 43 seconds 00002000:00080000:3.0:1781281097.945219:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:246 count 1 00010000:00010000:3.0:1781281097.945228:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945236:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 71 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945242:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945244:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.945245:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 4/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945257:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 71 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.945263:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.945270:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f12aa75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083780544:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.945285:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 000000001b5f4b70 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.945784:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.945808:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.945905:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.945929:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.945962:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083779520:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.945981:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.946001:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805696 00010000:00010000:3.0:1781281097.946016:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 72 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.946030:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805824 00010000:00010000:3.0:1781281097.946038:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 5/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 73 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.946047:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805632 00010000:00010000:3.0:1781281097.949488:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 5/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 74 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.949561:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805760 00010000:00010000:3.0:1781281097.949578:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 5/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 67 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.949595:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4794 00000100:00100000:3.0:1781281097.949601:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+74:2268:x1867808064805696:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.949615:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.949620:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 74 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949631:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 74 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949658:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004435339/0xce40b48e7cd0158d lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffde3 expref: 74 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949674:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949676:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949681:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949690:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 4/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949725:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.949791:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb22516f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2268:x1867808064805696:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 189us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.949798:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4794 00000100:00100000:3.0:1781281097.949817:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4795 00000100:00100000:3.0:1781281097.949821:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002252d9c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+72:2268:x1867808064805824:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.949830:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.949834:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 5/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 72 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949843:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 72 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949856:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949857:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949859:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949865:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 4/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949876:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.949892:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002252d9c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+72:2268:x1867808064805824:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 71us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.949899:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4795 00000100:00100000:3.0:1781281097.949912:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4796 00000100:00100000:3.0:1781281097.949916:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2268:x1867808064805632:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.949922:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.949925:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 5/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949935:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 71 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.949945:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949947:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.949948:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949955:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 4/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.949965:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.949979:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2268:x1867808064805632:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 63us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.949985:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4796 00000100:00100000:3.0:1781281097.949996:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4797 00000100:00100000:3.0:1781281097.950000:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+67:2268:x1867808064805760:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.950007:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.950011:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 5/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 67 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.950019:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 4/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 67 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.950033:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.950034:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.950036:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.950042:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 4/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.951888:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.951938:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+67:2268:x1867808064805760:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 1932us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.951951:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4797 00010000:00010000:3.0:1781281097.952004:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.952013:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.952023:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.952030:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281097.952297:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000006ece1721/2, rc 0, transno 1010 00000100:00100000:2.0:1781281097.952318:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ece1721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1781281097.952348:0:8137:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08407ce/0xce40b48e7ccff6f4 lrc: 0/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e9 expref: 66 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.952364:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c11f9572 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083779584:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.952386:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.952394:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.952400:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.952406:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.952412:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.952446:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1781281097.953640:0:14248:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f5d6bd/0xce40b48e7ccff630 lrc: 0/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff195 expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.953660:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb2284de pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083779456:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.953680:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.953690:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.953696:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.953703:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,1 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.953709:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 2/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953886:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953893:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953900:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953906:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082957512 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.953910:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953917:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953932:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fd:0x0].0x0 (000000005d3a9d9e) 00010000:00010000:1.0:1781281097.953935:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.953938:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953944:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082957512/0xce40b48e7cd21b94 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953971:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953977:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953982:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953987:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dc5810f4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.953990:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.953995:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954002:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x5a114248 (00000000aa054aa8) 00010000:00010000:1.0:1781281097.954005:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.954007:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954017:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dc5810f4/0xce40b48e7cd21ba9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954041:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954046:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954059:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954064:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002530f21b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954066:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954071:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954078:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x395:0x0].0x0 (00000000639c27f1) 00010000:00010000:1.0:1781281097.954080:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.954082:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954087:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002530f21b/0xce40b48e7cd21bb0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x395:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954123:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954134:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954140:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954146:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e3cd91b already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954147:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954153:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954174:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x1e68dc46 (000000008937527c) 00010000:00010000:1.0:1781281097.954177:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.954179:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954184:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e3cd91b/0xce40b48e7cd21bc5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954197:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954203:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954208:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954217:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000031c8d5c8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954219:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954224:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954231:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3ad:0x0].0x0 (0000000062e104fb) 00010000:00010000:1.0:1781281097.954233:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.954235:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 2/0,0 mode: --/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954241:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000031c8d5c8/0xce40b48e7cd21bcc lrc: 0/0,0 mode: --/COS res: [0x200000402:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954259:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954265:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954270:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954275:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d1865fcc already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954277:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954283:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954290:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x5e0db83a (0000000023cedac3) 00010000:00010000:1.0:1781281097.954293:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.954295:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954300:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1865fcc/0xce40b48e7cd21bda lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954313:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954319:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954325:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954329:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000085071d7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954331:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954337:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954344:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x239:0x0].0x0 (00000000bb6caf05) 00010000:00010000:1.0:1781281097.954346:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.954348:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954357:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000085071d7/0xce40b48e7cd21be1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954374:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954379:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954384:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954389:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006915cb54 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954391:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954396:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954403:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0xdde1c156 (0000000067b3c4de) 00010000:00010000:1.0:1781281097.954405:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.954407:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954412:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006915cb54/0xce40b48e7cd21c43 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25f:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954424:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954434:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954438:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954443:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dcd1d4b2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.954444:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954449:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954456:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x261:0x0].0x0 (00000000fc034e3c) 00010000:00010000:1.0:1781281097.954458:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.954459:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954464:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dcd1d4b2/0xce40b48e7cd21c4a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.954491:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.955327:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+16:3176:x1867808083778880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33375us (51692us total) trans 4294968063 rc 0/0 00000100:00100000:3.0:1781281097.955338:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00010000:00010000:1.0:1781281097.955649:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955657:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955667:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002621cf99 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955670:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955677:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955688:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x8344d724 (000000004530a32e) 00010000:00010000:1.0:1781281097.955691:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.955693:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955699:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002621cf99/0xce40b48e7cd21c58 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955713:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955719:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955725:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955729:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029b661d0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955731:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955737:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955744:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f7:0x0].0x0 (00000000096db458) 00010000:00010000:1.0:1781281097.955746:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.955747:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955752:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000029b661d0/0xce40b48e7cd21c5f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955776:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955782:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955787:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955793:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d07fc1c6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955794:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955800:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955807:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x220bffe4 (0000000079f1dc38) 00010000:00010000:1.0:1781281097.955809:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.955811:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955820:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d07fc1c6/0xce40b48e7cd21c7b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955838:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955843:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955848:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955852:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dd375de already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955855:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955859:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955865:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x384:0x0].0x0 (00000000a11cf4f5) 00010000:00010000:1.0:1781281097.955867:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.955869:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955873:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dd375de/0xce40b48e7cd21c82 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x384:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955903:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955913:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955918:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955923:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833fb648 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955926:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955931:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955939:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x17610ee3 (00000000044d4d6d) 00010000:00010000:1.0:1781281097.955941:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.955944:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955948:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833fb648/0xce40b48e7cd21c9e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955959:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955963:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955968:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955976:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a3c7ac32 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.955978:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955982:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955988:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37c:0x0].0x0 (00000000eb14708e) 00010000:00010000:1.0:1781281097.955990:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.955991:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.955996:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a3c7ac32/0xce40b48e7cd21ca5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956008:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956013:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956018:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956022:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfec5cfe already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956024:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956029:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956036:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x30480a6c (00000000e5688875) 00010000:00010000:1.0:1781281097.956038:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956040:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956044:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfec5cfe/0xce40b48e7cd21cc1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956054:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956059:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956064:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956069:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d1cdc8bd already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956071:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956076:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956082:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f5:0x0].0x0 (0000000048065dac) 00010000:00010000:1.0:1781281097.956083:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956085:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956093:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1cdc8bd/0xce40b48e7cd21cc8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956111:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956117:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956123:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956128:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000244f2dcd already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956130:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956134:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956141:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x14be06ab (000000001ba3c805) 00010000:00010000:1.0:1781281097.956143:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956145:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956150:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000244f2dcd/0xce40b48e7cd21cb3 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956162:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956172:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956177:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956181:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a05a721c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956183:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956188:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956195:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22f:0x0].0x0 (000000000064636d) 00010000:00010000:1.0:1781281097.956197:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956198:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956203:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a05a721c/0xce40b48e7cd21cd6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956217:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956222:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956227:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956235:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ad51d6c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956236:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956241:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956247:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x4e78d319 (00000000f5d23c62) 00010000:00010000:1.0:1781281097.956249:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956250:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956255:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ad51d6c/0xce40b48e7cd21ceb lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956267:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956271:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956276:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956281:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000002a847c3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956282:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956286:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956293:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f3:0x0].0x0 (0000000003cde912) 00010000:00010000:1.0:1781281097.956295:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956296:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956301:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002a847c3/0xce40b48e7cd21cf2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956315:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956321:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956327:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956331:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d74233a2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956333:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956338:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956346:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x77103a66 (000000009ecb2db0) 00010000:00010000:1.0:1781281097.956348:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956350:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956358:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d74233a2/0xce40b48e7cd21d07 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956372:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956378:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956383:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956387:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000080a7fefb already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956389:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956393:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956400:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x231:0x0].0x0 (00000000b3d14d67) 00010000:00010000:1.0:1781281097.956402:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956404:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956409:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000080a7fefb/0xce40b48e7cd21d0e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956425:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956435:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956441:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956446:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000097764e93 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956447:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956453:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956460:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xe2501d74 (0000000007ba61ef) 00010000:00010000:1.0:1781281097.956463:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956465:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956470:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000097764e93/0xce40b48e7cd21d23 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956493:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956498:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956503:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956512:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d8556b73 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956514:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956519:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956526:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ef:0x0].0x0 (000000002ea904e8) 00010000:00010000:1.0:1781281097.956528:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956530:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956534:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8556b73/0xce40b48e7cd21d2a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956576:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956582:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956587:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956592:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa64202e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956594:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956599:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956607:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0xc4fc354d (000000001b8df50f) 00010000:00010000:1.0:1781281097.956609:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956611:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956616:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa64202e/0xce40b48e7cd21d3f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956629:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956634:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956639:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956644:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002aa2c9c9 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956645:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956651:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956657:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x233:0x0].0x0 (000000007ef33e22) 00010000:00010000:1.0:1781281097.956659:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956661:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956670:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002aa2c9c9/0xce40b48e7cd21d46 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956684:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956690:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956695:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956701:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f624da37 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956703:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956708:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956716:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xd8045a37 (000000004f144573) 00010000:00010000:1.0:1781281097.956718:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956719:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956724:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f624da37/0xce40b48e7cd21d9a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956737:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956746:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956751:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956756:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a975201 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956758:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956763:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956770:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1eb:0x0].0x0 (0000000086fad4e2) 00010000:00010000:1.0:1781281097.956772:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956773:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956778:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a975201/0xce40b48e7cd21da1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956792:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956798:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956804:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956812:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046254189 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956814:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956820:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956827:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x8e4542d7 (000000000eec574b) 00010000:00010000:1.0:1781281097.956829:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956831:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956836:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046254189/0xce40b48e7cd21db6 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956848:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956853:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956858:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956863:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000071d978bf already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956865:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956870:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956877:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e9:0x0].0x0 (00000000d8c8139f) 00010000:00010000:1.0:1781281097.956879:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956881:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956886:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071d978bf/0xce40b48e7cd21dbd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956901:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956907:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956912:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956918:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b24957a6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956920:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956925:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956932:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x9e0a5f7e (00000000a5baf461) 00010000:00010000:1.0:1781281097.956934:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.956936:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956945:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b24957a6/0xce40b48e7cd2206b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956958:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956963:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956968:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956974:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f55ef574 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.956975:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956980:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956987:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f2:0x0].0x0 (00000000357ab1d0) 00010000:00010000:1.0:1781281097.956988:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.956990:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.956995:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f55ef574/0xce40b48e7cd22072 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957010:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957019:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957025:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957030:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007284a589 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957031:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957037:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957044:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x8cffc40b (00000000eb312daa) 00010000:00010000:1.0:1781281097.957046:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957047:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957052:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007284a589/0xce40b48e7cd2208e lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957063:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957068:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957072:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957079:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000105653c7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957081:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957085:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957092:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20d:0x0].0x0 (000000005c561e02) 00010000:00010000:1.0:1781281097.957093:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957095:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957099:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000105653c7/0xce40b48e7cd22095 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957113:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957118:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957123:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957127:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000099ffc0e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957129:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957134:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957141:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xddbda88f (0000000086b5e064) 00010000:00010000:1.0:1781281097.957143:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957145:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957150:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000099ffc0e/0xce40b48e7cd220b1 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957161:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957166:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957172:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957176:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee49ae7f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957178:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957182:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957188:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x200:0x0].0x0 (000000001708121e) 00010000:00010000:1.0:1781281097.957190:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957192:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957201:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee49ae7f/0xce40b48e7cd220b8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957215:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957220:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957225:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957230:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aa8bb7df already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957231:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957237:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957243:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x2c71d537 (000000003886c019) 00010000:00010000:1.0:1781281097.957245:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957247:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957252:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aa8bb7df/0xce40b48e7cd220d4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957263:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957270:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957275:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957279:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033209eb2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957281:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957285:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957291:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x263:0x0].0x0 (00000000c8c7ecfb) 00010000:00010000:1.0:1781281097.957292:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957294:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 2/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957299:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033209eb2/0xce40b48e7cd220db lrc: 0/0,0 mode: --/COS res: [0x200000402:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957312:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957318:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957323:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957331:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e9ce1b08 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957333:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957338:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957345:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xf17aab4e (0000000010bae9cd) 00010000:00010000:1.0:1781281097.957346:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957348:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957353:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9ce1b08/0xce40b48e7cd220f7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957363:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957369:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957375:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957379:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fa0573ec already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957381:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957386:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957393:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x225:0x0].0x0 (000000002ed17150) 00010000:00010000:1.0:1781281097.957396:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957397:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 2/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957402:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa0573ec/0xce40b48e7cd220fe lrc: 0/0,0 mode: --/COS res: [0x200000402:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957414:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957419:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957424:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957429:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca72b92a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957431:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957435:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957441:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0xc144154 (00000000a362d105) 00010000:00010000:1.0:1781281097.957444:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957445:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957454:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca72b92a/0xce40b48e7cd2211a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957466:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957485:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957491:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957496:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdfff942 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957498:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957503:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957509:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1fa:0x0].0x0 (000000003ca158ae) 00010000:00010000:1.0:1781281097.957510:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957512:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957516:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cdfff942/0xce40b48e7cd22121 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957529:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957539:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957568:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957573:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceec7a8f already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957575:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957580:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957588:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x56ca4f59 (000000000d7f90d4) 00010000:00010000:1.0:1781281097.957590:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957591:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957596:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceec7a8f/0xce40b48e7cd2213d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957609:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957614:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957619:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957626:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000edfb6f85 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957628:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957633:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957639:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x235:0x0].0x0 (0000000046ab8c9f) 00010000:00010000:1.0:1781281097.957640:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957642:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957646:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edfb6f85/0xce40b48e7cd22144 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957658:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957663:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957668:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957672:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000783f699d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957674:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957679:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957685:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x106120ec (00000000043cbc03) 00010000:00010000:1.0:1781281097.957687:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957688:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957693:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000783f699d/0xce40b48e7cd22160 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957703:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957708:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957712:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957717:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a949d4de already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957719:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957724:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957730:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25f:0x0].0x0 (00000000d2dc6be2) 00010000:00010000:1.0:1781281097.957732:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957733:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957742:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a949d4de/0xce40b48e7cd22167 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957753:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957759:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957764:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957770:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ee58c1c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957772:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957777:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957784:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x46e192ec (00000000d7013489) 00010000:00010000:1.0:1781281097.957786:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957787:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957792:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ee58c1c/0xce40b48e7cd22183 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957803:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957811:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957815:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957820:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdf693c7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957822:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957826:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957833:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22d:0x0].0x0 (000000005f778797) 00010000:00010000:1.0:1781281097.957835:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957836:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957841:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cdf693c7/0xce40b48e7cd2218a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6157 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957854:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957859:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957864:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957873:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c71dbf8e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957875:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957880:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957886:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0xfe8990f0 (00000000521683dc) 00010000:00010000:1.0:1781281097.957888:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957890:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957895:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c71dbf8e/0xce40b48e7cd22198 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957904:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957909:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957914:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957919:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006fb266d3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957921:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957926:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957932:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e5:0x0].0x0 (0000000074f3729b) 00010000:00010000:1.0:1781281097.957934:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.957936:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957941:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006fb266d3/0xce40b48e7cd2219f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957952:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957957:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957962:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957967:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001094136e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.957969:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957974:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957981:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x977fac0d (00000000b6ed70b7) 00010000:00010000:1.0:1781281097.957983:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.957985:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.957993:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001094136e/0xce40b48e7cd221ad lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958003:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958008:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958013:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958018:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017ae221c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958019:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958024:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958031:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e4:0x0].0x0 (00000000e39da13e) 00010000:00010000:1.0:1781281097.958032:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.958034:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958039:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017ae221c/0xce40b48e7cd221b4 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958051:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958060:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958066:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958070:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000336dffd7 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958072:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958078:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958085:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x56ca4f59 (000000003e8e6ae0) 00010000:00010000:1.0:1781281097.958088:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.958089:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958094:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000336dffd7/0xce40b48e7cd221d0 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958106:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958112:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958117:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958126:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad6e01b4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958127:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958133:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958139:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x232:0x0].0x0 (0000000005a25b42) 00010000:00010000:1.0:1781281097.958141:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.958142:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958147:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad6e01b4/0xce40b48e7cd221d7 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958161:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958167:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958172:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958177:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd082e3d already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958178:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958183:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958190:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x106120ec (000000001d91642c) 00010000:00010000:1.0:1781281097.958192:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.958194:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958199:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd082e3d/0xce40b48e7cd221f3 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958211:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958216:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958222:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958226:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b263eedb already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958228:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958233:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958240:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25d:0x0].0x0 (00000000e61cd319) 00010000:00010000:1.0:1781281097.958242:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.958243:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 2/0,0 mode: --/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958253:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b263eedb/0xce40b48e7cd221fa lrc: 0/0,0 mode: --/COS res: [0x200000402:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958268:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958274:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958279:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958285:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067a58f76 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958286:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958292:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958298:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x8cffc40b (0000000059c32305) 00010000:00010000:1.0:1781281097.958300:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.958302:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958307:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067a58f76/0xce40b48e7cd22216 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958319:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958328:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958334:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958338:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000024b5da5a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958340:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958345:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958352:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20a:0x0].0x0 (00000000d599d343) 00010000:00010000:1.0:1781281097.958354:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.958355:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 2/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958360:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000024b5da5a/0xce40b48e7cd2221d lrc: 0/0,0 mode: --/COS res: [0x200000402:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958372:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958377:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958382:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958391:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058fc6128 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958393:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958398:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958405:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x2c71d537 (00000000fcf11d1d) 00010000:00010000:1.0:1781281097.958407:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.958409:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958414:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058fc6128/0xce40b48e7cd22239 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958424:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958429:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958434:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958439:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f3c60d09 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.958440:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958446:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958453:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x260:0x0].0x0 (00000000ebc0473d) 00010000:00010000:1.0:1781281097.958455:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.958456:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.958461:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f3c60d09/0xce40b48e7cd22240 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960004:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1781281097.960824:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3177:x1867808083778176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36495us (47651us total) trans 4294968308 rc 0/0 00000100:00100000:2.0:1781281097.960838:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00010000:00010000:2.0:1781281097.960884:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1781281097.960889:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960902:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002a5856cb already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.960905:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960914:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960932:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 1/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960938:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5856cb/0xce40b48e7cd2242a lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960957:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281097.960961:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960967:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e7b3a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.960969:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960974:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 3/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960983:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 1/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.960988:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd22431 lrc: 0/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961003:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281097.961005:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961011:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046b443e6 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281097.961013:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 3/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961018:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 4/0,0 mode: PW/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961026:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 2/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961032:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.961033:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.961034:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281097.961121:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c11f9572 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281097.961326:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.961373:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780608 00000100:00100000:2.0:1781281097.961413:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:2.0:1781281097.961418:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2284de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3175:x1867808083780608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281097.961444:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:272 count 1 00010000:00010000:2.0:1781281097.961463:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961491:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 65 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961615:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.961617:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.961620:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 4/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961647:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 65 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961657:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 65 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.961668:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edb9479b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083780672:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.961708:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 0000000022ac83d5 going to sleep for 43 seconds 00010000:00010000:2.0:1781281097.961740:0:7752:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c0c929/0xce40b48e7cd00dec lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb04 expref: 69 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.961751:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083779776:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.961832:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961842:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961848:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961855:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961866:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.961882:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1781281097.962170:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1781281097.962175:0:14248:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b443e6/0xce40b48e7cd22423 lrc: 0/0,0 mode: --/PW res: [0xe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281097.962327:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011fa024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3176:x1867808083778624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44068us (60874us total) trans 4294968065 rc 0/0 00000100:00100000:0.0:1781281097.962335:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1781281097.962488:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065fc3517 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3175:x1867808083779648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33218us (33514us total) trans 4294968064 rc 0/0 00010000:00010000:3.0:1781281097.962618:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.962623:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.962630:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d3a83c79 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.962634:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.962640:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.962655:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 1/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.962661:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a83c79/0xce40b48e7cd22438 lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.963400:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00010000:00010000:2.0:1781281097.963427:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1781281097.963466:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b0664d22/2, rc 0, transno 769 00000100:00100000:2.0:1781281097.963490:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0664d22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.963781:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963805:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963823:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963865:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963876:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963967:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.963986:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.964000:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.964013:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281097.964044:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1781281097.964242:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281097.964266:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083779840:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.964291:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.964321:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f1e1dd4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083779904:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.964331:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.964351:0:7754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b1addb pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083779968:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.964359:0:7754:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.964383:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805952 00010000:00010000:3.0:1781281097.964409:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 66 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.964429:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064805888 00010000:00010000:3.0:1781281097.964437:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 67 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.964447:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806016 00010000:00010000:3.0:1781281097.964455:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 69 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.964466:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806144 00010000:00010000:3.0:1781281097.964485:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 5/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 70 pid: 14277 timeout: 720 lvb_type: 0 00000004:00080000:2.0:1781281097.964718:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b7e79b84/2, rc 0, transno 767 00000100:00100000:2.0:1781281097.964729:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7e79b84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281097.964885:0:14239:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df5cee7c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083780224:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.964900:0:14239:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1781281097.964928:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000affb6812/2, rc 0, transno 768 00000100:00100000:0.0:1781281097.964932:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000affb6812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083779648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281097.964937:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1781281097.964947:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281097.964991:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281097.965024:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075f4167c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083780288:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.965034:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.965155:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009896e16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.965283:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1781281097.965447:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965457:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965464:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965470:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6705277 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965485:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965493:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965508:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x46e192ec (00000000b5e9161d) 00010000:00010000:1.0:1781281097.965511:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.965516:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965527:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6705277/0xce40b48e7cd2225c lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965567:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965573:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965578:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965582:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c4d2fed6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965584:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965589:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965597:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22a:0x0].0x0 (00000000e0df90c8) 00010000:00010000:1.0:1781281097.965599:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.965602:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965607:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4d2fed6/0xce40b48e7cd22263 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965621:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965631:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965636:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965640:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f1138198 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965642:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965647:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965654:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xddbda88f (00000000577d435b) 00010000:00010000:1.0:1781281097.965657:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.965658:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965664:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f1138198/0xce40b48e7cd2227f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965679:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965684:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965689:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965699:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000582dda88 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965701:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965706:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965714:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1ff:0x0].0x0 (00000000cfbe4258) 00010000:00010000:1.0:1781281097.965716:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.965718:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965725:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000582dda88/0xce40b48e7cd22286 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965740:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965746:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965751:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965756:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000554b98e8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965769:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965775:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965783:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xf17aab4e (00000000d4345b53) 00010000:00010000:1.0:1781281097.965786:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.965788:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965793:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000554b98e8/0xce40b48e7cd222a2 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965807:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965812:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965817:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965822:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059764af4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965823:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965829:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965836:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x222:0x0].0x0 (00000000178e2526) 00010000:00010000:1.0:1781281097.965838:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.965840:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965850:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059764af4/0xce40b48e7cd222a9 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965865:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965871:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965877:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965882:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092b3444e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965884:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965889:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965896:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0xc144154 (00000000734ca10d) 00010000:00010000:1.0:1781281097.965898:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.965900:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965906:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092b3444e/0xce40b48e7cd222c5 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965919:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965927:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965932:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965937:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dad01389 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965939:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965943:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965950:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f9:0x0].0x0 (0000000092ffa8ed) 00010000:00010000:1.0:1781281097.965951:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.965953:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965958:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dad01389/0xce40b48e7cd222cc lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965969:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965974:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965979:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965987:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000057f793d1 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.965989:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.965994:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966000:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x9e0a5f7e (00000000e01e8158) 00010000:00010000:1.0:1781281097.966002:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966004:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966009:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000057f793d1/0xce40b48e7cd222e8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966019:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966025:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966030:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966035:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007633493e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966036:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966041:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966048:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f1:0x0].0x0 (0000000042cdde64) 00010000:00010000:1.0:1781281097.966050:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966062:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966067:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007633493e/0xce40b48e7cd222ef lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966081:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966086:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966090:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966096:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003bed23e0 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966097:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966102:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966109:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0xfe8990f0 (000000005724f5bf) 00010000:00010000:1.0:1781281097.966111:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966112:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966121:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003bed23e0/0xce40b48e7cd222fd lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966132:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966138:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966143:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966147:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000884572a8 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966149:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966154:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966172:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e6:0x0].0x0 (0000000036ea2b0b) 00010000:00010000:1.0:1781281097.966174:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966176:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966181:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000884572a8/0xce40b48e7cd22304 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966193:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966203:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966207:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966212:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f40f4cd2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966214:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966219:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966225:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0xf138ac0d (000000009077410e) 00010000:00010000:1.0:1781281097.966227:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966229:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966234:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f40f4cd2/0xce40b48e7cd22312 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966245:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966250:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966256:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966264:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000002217ff2 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966266:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966272:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966278:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e3:0x0].0x0 (00000000e5a036b1) 00010000:00010000:1.0:1781281097.966280:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966282:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966287:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002217ff2/0xce40b48e7cd22319 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6155 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966298:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966303:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966308:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966312:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001f5d8bf6 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966314:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966319:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966327:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x12eaac0d (000000002058a2b6) 00010000:00010000:1.0:1781281097.966329:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966331:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966336:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001f5d8bf6/0xce40b48e7cd22343 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966348:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966353:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966358:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966363:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000893b363e already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966365:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966370:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966376:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e2:0x0].0x0 (00000000b49ac97e) 00010000:00010000:1.0:1781281097.966378:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966380:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966389:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000893b363e/0xce40b48e7cd2234a lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966401:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966407:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966413:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966417:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000130904b4 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966419:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966424:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966430:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0xaaaf1035 (00000000d7784fdf) 00010000:00010000:1.0:1781281097.966432:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966434:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966438:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000130904b4/0xce40b48e7cd22358 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966450:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966460:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966464:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966469:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008b32cfb3 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966479:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966485:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966492:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dc:0x0].0x0 (000000008a595136) 00010000:00010000:1.0:1781281097.966494:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966496:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966501:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008b32cfb3/0xce40b48e7cd2235f lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966515:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966521:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966526:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966535:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000000906608 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966537:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966567:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966575:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1db:0x0].0x3db54834 (00000000bde54e29) 00010000:00010000:1.0:1781281097.966577:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966578:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966583:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000906608/0xce40b48e7cd22374 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1db:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966598:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966603:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966608:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966612:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000076930d14 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966614:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966620:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966627:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1dd:0x0].0x0 (000000009f6df0e4) 00010000:00010000:1.0:1781281097.966629:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966630:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966635:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076930d14/0xce40b48e7cd2237b lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966649:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966654:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966659:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966663:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966665:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966670:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966677:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0xa375d043 (00000000ffb54c4a) 00010000:00010000:1.0:1781281097.966679:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966680:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966690:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053486f83/0xce40b48e7cd22390 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966701:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966706:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966712:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966717:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966719:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966724:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966729:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1df:0x0].0x0 (00000000f12ce057) 00010000:00010000:1.0:1781281097.966731:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966733:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966738:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005c770f98/0xce40b48e7cd22397 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966751:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966760:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966765:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966770:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc851d66 already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966772:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966777:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966785:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x820cea43 (0000000083d40933) 00010000:00010000:1.0:1781281097.966787:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966789:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966794:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc851d66/0xce40b48e7cd223ac lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966805:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966811:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966816:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966825:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082f6faed already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966827:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966832:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966839:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e0:0x0].0x0 (0000000096f4694f) 00010000:00010000:1.0:1781281097.966841:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966842:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966847:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082f6faed/0xce40b48e7cd223b3 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966862:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966868:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966873:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966878:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e613da0c already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966880:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966885:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966892:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x6fca4125 (000000009977072d) 00010000:00010000:1.0:1781281097.966894:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1781281097.966896:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966902:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e613da0c/0xce40b48e7cd223c8 lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1de:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966911:0:3161:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(COS) ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,1 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966917:0:3161:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 2/0,0 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966922:0:3161:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966926:0:3161:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e04ec7a already unused, calling callback (00000000bff7e25e) 00010000:00010000:1.0:1781281097.966928:0:3161:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 3/0,0 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966932:0:3161:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 4/0,0 mode: COS/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966939:0:3161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e1:0x0].0x0 (00000000c68e3776) 00010000:00010000:1.0:1781281097.966941:0:3161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1781281097.966943:0:3161:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 2/0,0 mode: --/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.966952:0:3161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e04ec7a/0xce40b48e7cd223cf lrc: 0/0,0 mode: --/COS res: [0x200000402:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.967053:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1781281097.967065:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000499d901d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.967117:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.967173:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806080 00010000:00010000:3.0:1781281097.967198:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 68 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967221:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806272 00010000:00010000:3.0:1781281097.967231:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 69 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967241:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806400 00010000:00010000:3.0:1781281097.967250:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 5/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 71 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967260:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806208 00010000:00010000:3.0:1781281097.967267:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 70 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967276:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806336 00010000:00010000:3.0:1781281097.967284:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 5/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 72 pid: 14240 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967295:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806464 00010000:00010000:3.0:1781281097.967303:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 73 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.967321:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4798 00000100:00100000:3.0:1781281097.967327:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3734a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+70:2268:x1867808064805952:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.967339:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967343:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967352:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967372:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7b80d8/0xce40b48e7ccffcff lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff44a expref: 70 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967384:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967386:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967390:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967398:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 4/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967432:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.967466:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3734a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+69:2268:x1867808064805952:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 139us (3687us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.967485:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4798 00000100:00100000:3.0:1781281097.967531:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4799 00000100:00100000:3.0:1781281097.967536:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+68:2268:x1867808064805888:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.967558:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967563:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 68 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967572:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 68 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967584:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1f545e/0xce40b48e7ccff7aa lrc: 0/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff22f expref: 68 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967593:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967595:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967596:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967602:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 4/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967618:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.967635:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+67:2268:x1867808064805888:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 99us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.967641:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4799 00000100:00100000:3.0:1781281097.967652:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4800 00000100:00100000:3.0:1781281097.967656:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+73:2268:x1867808064806016:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281097.967664:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967668:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967681:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967695:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000254caf02/0xce40b48e7cd1ba20 lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0881c expref: 73 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967704:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967705:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967707:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967713:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 4/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967729:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.967746:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+72:2268:x1867808064806016:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 89us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.967752:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4800 00000100:00100000:3.0:1781281097.967763:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4801 00000100:00100000:3.0:1781281097.967767:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2270:x1867808064806144:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281097.967774:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967777:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 5/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 71 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967785:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 71 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967800:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967801:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967803:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967808:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 4/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967818:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.967832:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+71:2270:x1867808064806144:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 64us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.967838:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4801 00000100:00100000:3.0:1781281097.967850:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4802 00000100:00100000:3.0:1781281097.967853:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+66:2270:x1867808064806080:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281097.967860:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967864:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967871:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967883:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016831656/0xce40b48e7cd01a64 lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffdb expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967892:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967893:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967896:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967902:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 4/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967921:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.967936:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+65:2270:x1867808064806080:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 82us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.967942:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4802 00000100:00100000:3.0:1781281097.967954:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4803 00000100:00100000:3.0:1781281097.967958:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0c1439 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+64:2269:x1867808064806272:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281097.967964:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.967967:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 64 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967974:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 64 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.967986:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967987:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.967989:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.967995:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 4/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968006:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.968023:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0c1439 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+64:2269:x1867808064806272:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 64us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.968029:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4803 00000100:00100000:3.0:1781281097.968040:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4804 00000100:00100000:3.0:1781281097.968043:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cf7a71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+70:2269:x1867808064806400:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281097.968049:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.968053:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 5/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 70 pid: 14261 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968061:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 4/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 70 pid: 14261 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968072:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968074:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968075:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968082:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 4/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968093:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.968109:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cf7a71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+70:2269:x1867808064806400:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 64us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.968115:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4804 00000100:00100000:3.0:1781281097.968127:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4805 00000100:00100000:3.0:1781281097.968131:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421391fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+63:2269:x1867808064806208:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281097.968138:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.968142:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 63 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968149:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 63 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968162:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000623c8f63/0xce40b48e7cd01b4b lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0002f expref: 63 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968172:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968173:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968175:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968181:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 4/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968199:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.968211:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421391fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+62:2269:x1867808064806208:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 79us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.968216:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4805 00000100:00100000:3.0:1781281097.968239:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4806 00000100:00100000:3.0:1781281097.968243:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+69:2269:x1867808064806336:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281097.968249:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.968252:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 5/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 69 pid: 14240 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968260:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 69 pid: 14240 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968272:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968273:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968275:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968281:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 4/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968291:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.968302:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+69:2269:x1867808064806336:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 58us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.968308:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4806 00000100:00100000:3.0:1781281097.968318:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4807 00000100:00100000:3.0:1781281097.968322:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+68:2269:x1867808064806464:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281097.968328:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.968331:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 68 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968339:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 68 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.968350:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968351:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.968353:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968359:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 4/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968369:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.968380:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+68:2269:x1867808064806464:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 57us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.968386:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4807 00010000:00010000:3.0:1781281097.968435:0:14274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab3e5553/0xce40b48e7cd00d4b lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffabe expref: 67 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.968444:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083780032:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.968462:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968483:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968489:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968497:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968504:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.968521:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281097.968822:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c3ba4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3178:x1867808083779072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37375us (38305us total) trans 4294968066 rc 0/0 00000100:00100000:3.0:1781281097.968833:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000004:00080000:2.0:1781281097.969428:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d3dbdb4c/2, rc 0, transno 770 00000100:00100000:2.0:1781281097.969442:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3dbdb4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083779072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.969527:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e403ae05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.969575:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.969683:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780736 00000100:00100000:3.0:1781281097.969712:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780864 00000100:00100000:3.0:1781281097.969726:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780800 00000100:00100000:3.0:1781281097.969741:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:3.0:1781281097.969746:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+18:3175:x1867808083780736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.969778:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:434 count 1 00010000:00010000:3.0:1781281097.969801:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969818:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 2/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 66 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969825:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.969827:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.969829:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 4/0,1 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969850:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 3/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 66 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969861:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 4/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 66 pid: 7752 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.969870:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083780992:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.969900:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d811a519 going to sleep for 6 seconds 00010000:00010000:3.0:1781281097.969918:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969932:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969940:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969946:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.969959:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281097.970563:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d6b34d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3178:x1867808083778496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39733us (40105us total) trans 4294968309 rc 0/0 00000100:00100000:3.0:1781281097.970573:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1781281097.970591:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:3.0:1781281097.970595:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000321b98a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3178:x1867808083780864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.970609:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:243 count 1 00010000:00010000:3.0:1781281097.970621:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970633:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 66 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970639:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.970640:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.970641:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 4/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970664:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 66 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970672:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 66 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.970681:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6cf7a71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14244:1867808083781056:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.970702:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc935370 going to sleep for 6 seconds 00010000:00010000:3.0:1781281097.970717:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970724:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970731:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970737:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.970745:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1781281097.971022:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d34b60a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:3178:x1867808083778240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40394us (40646us total) trans 4294968310 rc 0/0 00000100:00100000:3.0:1781281097.971030:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1781281097.971044:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:3.0:1781281097.971048:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c23147e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+18:3178:x1867808083780800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.971325:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:247 count 1 00010000:00010000:3.0:1781281097.971338:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971349:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971355:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.971356:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.971357:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 4/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971374:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 66 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971381:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 66 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.971389:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022f8bfc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083781120:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.971410:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 00000000acb0b455 going to sleep for 6 seconds 00010000:00010000:3.0:1781281097.971425:0:7754:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971433:0:7754:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971441:0:7754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971451:0:7754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.971460:0:7754:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1781281097.972238:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1781281097.972244:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972253:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ed627724 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281097.972256:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972264:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972284:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 1/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972290:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed627724/0xce40b48e7cd22454 lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972306:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281097.972308:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972315:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e1495ad0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281097.972316:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972322:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972330:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 1/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972336:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1495ad0/0xce40b48e7cd22446 lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972348:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281097.972350:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972355:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000071eb48af already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281097.972357:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972362:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972369:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 1/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972379:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071eb48af/0xce40b48e7cd2243f lrc: 0/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972392:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281097.972393:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972398:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008192914f already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281097.972400:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972405:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972414:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 1/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972419:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008192914f/0xce40b48e7cd2244d lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972430:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281097.972431:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281097.972433:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281097.972470:0:14226:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7fe4a60/0xce40b48e7cd1afa7 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c084bf expref: 66 pid: 14240 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.972492:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d648dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083780416:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.972512:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972520:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972525:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972533:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.972539:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.972731:0:14239:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.972739:0:14239:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.972745:0:14239:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.972751:0:14239:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.972929:0:7754:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001483d93 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3178:x1867808083778816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41612us (42459us total) trans 4294968067 rc 0/0 00000100:00100000:3.0:1781281097.972939:0:7754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00010000:00010000:3.0:1781281097.972969:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1781281097.972999:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000083d3ef0f/2, rc 0, transno 1014 00000100:00100000:3.0:1781281097.973013:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083d3ef0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778240:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281097.973025:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000012218d17/2, rc 0, transno 1013 00000100:00100000:3.0:1781281097.973028:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012218d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778496:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281097.973039:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d27c9c17/2, rc 0, transno 771 00000100:00100000:3.0:1781281097.973047:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d27c9c17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083778816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1781281097.973136:0:14239:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281097.973424:0:14239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d81cd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3178:x1867808083780160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34521us (34681us total) trans 4294968311 rc 0/0 00000100:00100000:1.0:1781281097.973432:0:14239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00010000:00010000:1.0:1781281097.973450:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281097.973453:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973459:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000011eb364e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281097.973462:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973488:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973501:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 1/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973507:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011eb364e/0xce40b48e7cd2245b lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973521:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281097.973523:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281097.973524:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281097.973536:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973561:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973568:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973573:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.973587:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1781281097.973877:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1781281097.974253:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008544c56b/2, rc 0, transno 1015 00000100:00100000:3.0:1781281097.974260:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008544c56b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.974358:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ec8ad43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781312:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1781281097.974394:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281097.974398:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974406:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d25f62a6 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.974409:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974421:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974435:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 1/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974440:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d25f62a6/0xce40b48e7cd22462 lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974457:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.974459:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.974464:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb50e5d2 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.974466:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.974704:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157bb568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281097.974730:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.974746:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1781281097.974751:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bdc966fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281097.974782:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.974812:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083780928 00000100:00100000:2.0:1781281097.974839:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781376 00000100:00100000:2.0:1781281097.974852:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781184 00000100:00100000:2.0:1781281097.974868:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1781281097.974872:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093681051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3175:x1867808083780928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281097.974894:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:245 count 1 00010000:00010000:2.0:1781281097.974915:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.974930:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 65 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.974936:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.974938:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.974940:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 4/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.974964:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 65 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.974974:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 65 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.974985:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076b417da pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083781440:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.975014:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 0000000085896c47 going to sleep for 43 seconds 00000100:00100000:2.0:1781281097.975032:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1781281097.975036:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc51e6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3175:x1867808083781376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281097.975048:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:241 count 1 00010000:00010000:2.0:1781281097.975470:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.975493:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 65 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.975499:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.975500:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.975502:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 4/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.975523:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 65 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.975531:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 65 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.975540:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012516b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083781504:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.975589:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 000000008af78103 going to sleep for 43 seconds 00000004:00080000:2.0:1781281097.975616:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f0d70729/2, rc 0, transno 1011 00000100:00100000:2.0:1781281097.975625:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f0d70729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083778112:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1781281097.975681:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.975699:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 1/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.975705:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22470 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.975731:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281097.975884:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3177:x1867808083778752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30918us (31155us total) trans 4294968068 rc 0/0 00000100:00100000:0.0:1781281097.975893:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1781281097.975911:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781312 00000100:00100000:0.0:1781281097.975932:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:0.0:1781281097.975936:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b348c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3175:x1867808083781184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1781281097.975949:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:269 count 1 00010000:00010000:0.0:1781281097.975963:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.975973:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 61 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.975984:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.975985:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281097.975987:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 4/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.976004:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 61 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.976011:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 61 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.976020:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075f4167c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14226:1867808083781568:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281097.976038:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 000000007b87d8b9 going to sleep for 43 seconds 00000100:00100000:1.0:1781281097.976388:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dacaadb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3178:x1867808083780096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36552us (37580us total) trans 4294968312 rc 0/0 00000004:00080000:3.0:1781281097.976487:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000007f1a637c/2, rc 0, transno 1016 00000100:00100000:3.0:1781281097.976492:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f1a637c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.976502:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281097.976508:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418c7a9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.976532:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.976577:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781248 00000100:00100000:1.0:1781281097.976717:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:3.0:1781281097.976755:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:3.0:1781281097.976772:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3178:x1867808083781312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.976790:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:275 count 1 00010000:00010000:3.0:1781281097.976804:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976816:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 61 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976823:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.976825:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.976826:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 4/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976848:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 61 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976857:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 61 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.976867:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0fbf7b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7755:1867808083781632:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.976888:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e7a2223c going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.976905:0:7754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:3.0:1781281097.976909:0:7754:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3178:x1867808083781248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.976925:0:7754:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:250 count 1 00010000:00010000:3.0:1781281097.976936:0:7754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976947:0:7754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 61 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976953:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.976954:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.976956:0:7754:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 4/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976973:0:7754:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 61 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.976981:0:7754:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.976990:0:7754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016b93773 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7754:1867808083781696:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.977008:0:7754:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000d2812a going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.977091:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281097.977098:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.977121:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.977143:0:14277:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781824 00000100:00100000:3.0:1781281097.977307:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:3.0:1781281097.977311:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+19:3178:x1867808083781824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.977324:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:258 count 1 00010000:00010000:3.0:1781281097.977336:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977346:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977353:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.977354:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.977355:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 4/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977373:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977381:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.977389:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083781888:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.977422:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 000000001a4b0011 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.977437:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281097.977444:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017b45a95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.977467:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1781281097.977492:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.977494:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.977496:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.977618:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.977642:0:14275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d3cc6d/0xce40b48e7cd00ac7 lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9a6 expref: 65 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.977655:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f12aa75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083780544:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.977671:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977680:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977686:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977694:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977699:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.977718:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281097.977941:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c9fe8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3175:x1867808083779712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47604us (48919us total) trans 4294968069 rc 0/0 00000100:00100000:3.0:1781281097.977949:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000004:00080000:3.0:1781281097.978140:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c5058fa8/2, rc 0, transno 773 00000100:00100000:3.0:1781281097.978149:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5058fa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083779712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.978262:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009f4c6dbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781952:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.978284:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.978312:0:14275:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781760 00000100:00100000:3.0:1781281097.978326:0:14275:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083781952 00000100:00100000:3.0:1781281097.978335:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:3.0:1781281097.978339:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006406b574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+20:3175:x1867808083781760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.978351:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:270 count 1 00010000:00010000:3.0:1781281097.978363:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978374:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 61 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978381:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.978382:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.978383:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 4/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978400:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 61 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978409:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 61 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.978416:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d572d1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083782016:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.978437:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 000000008d2c7fdd going to sleep for 43 seconds 00010000:00010000:3.0:1781281097.978446:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.978449:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978457:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029682757 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.978460:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978468:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978496:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 1/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978502:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd2247e lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.978517:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.978518:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.978520:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281097.978738:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1781281097.978743:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3178:x1867808083781952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281097.978767:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:429 count 1 00010000:00010000:2.0:1781281097.978780:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.978791:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 64 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.978798:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.978799:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.978800:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 4/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.978817:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 64 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.978825:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 64 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.978835:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000058cda886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083782080:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.978853:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c45e9b91 going to sleep for 43 seconds 00010000:00010000:0.0:1781281097.978988:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a754f5a/0xce40b48e7ccffc2d lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3ef expref: 61 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.978999:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083780352:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.979011:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979018:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979024:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979036:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979041:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979242:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281097.979428:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3177:x1867808083778432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34630us (34739us total) trans 4294968313 rc 0/0 00000100:00100000:0.0:1781281097.979435:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00010000:00010000:0.0:1781281097.979468:0:14278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb1bf6c5/0xce40b48e7cd1dbc9 lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09447 expref: 64 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.979490:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14278:1867808083780480:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.979503:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979509:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979514:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979520:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.979529:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281097.979654:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008f87dee6/2, rc 0, transno 1012 00000100:00100000:2.0:1781281097.979665:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f87dee6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778176:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281097.979674:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000005b758d73/2, rc 0, transno 1017 00000100:00100000:2.0:1781281097.979676:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b758d73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778432:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281097.979686:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000df937771/2, rc 0, transno 772 00000100:00100000:2.0:1781281097.979693:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df937771 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083778752:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281097.984103:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1781281097.984668:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+22:3177:x1867808083779008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39539us (39583us total) trans 4294968070 rc 0/0 00000100:00100000:0.0:1781281097.984680:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00010000:00010000:1.0:1781281097.984986:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281097.984993:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985005:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033bbad87 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281097.985008:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985017:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985039:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 1/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985045:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bbad87/0xce40b48e7cd22469 lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985074:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281097.985077:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985084:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ddb8830 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281097.985086:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985092:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985104:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 1/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985110:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd22477 lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.985125:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281097.985126:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281097.985127:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281097.986625:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1781281097.986682:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a56045fb/2, rc 0, transno 774 00000100:00100000:2.0:1781281097.986693:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a56045fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083779008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281097.987344:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987363:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987381:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987400:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987423:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987441:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987453:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.987464:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281097.987794:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083780992:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.987816:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.987850:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edb9479b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083780672:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.987865:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.987964:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076b417da pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083781440:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.987978:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.988000:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012516b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083781504:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.988010:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281097.988393:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6cf7a71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14244:1867808083781056:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281097.988405:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281097.988432:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806720 00010000:00010000:1.0:1781281097.988462:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 64 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.988616:0:7754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016b93773 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7754:1867808083781696:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.988628:0:7754:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.988648:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0fbf7b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7755:1867808083781632:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.988657:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.988770:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083781888:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.988781:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281097.988801:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000878e9aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083782272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281097.988856:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.988882:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1781281097.988887:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068ffcb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083782336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281097.988907:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281097.988937:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782272 00000100:00100000:2.0:1781281097.988964:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782336 00000100:00100000:2.0:1781281097.988980:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1781281097.988987:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be368255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+22:3177:x1867808083782272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281097.989018:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:261 count 1 00010000:00010000:2.0:1781281097.989047:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989078:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 60 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989085:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.989087:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.989090:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 4/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989114:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 60 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989124:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 60 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.989135:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083782400:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.989189:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 000000008af78103 going to sleep for 43 seconds 00000100:00100000:2.0:1781281097.989204:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1781281097.989207:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b8d9e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3177:x1867808083782336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281097.989218:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:259 count 1 00010000:00010000:2.0:1781281097.989227:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989236:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 60 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989241:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.989242:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281097.989243:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 4/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989257:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 60 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.989263:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 60 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.989271:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8b7e1a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083782464:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281097.989288:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 0000000039f5d647 going to sleep for 43 seconds 00000100:00100000:0.0:1781281097.989593:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.989690:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.989703:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.989723:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281097.989750:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075f4167c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14226:1867808083781568:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281097.989766:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281097.990224:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806656 00010000:00010000:1.0:1781281097.990245:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990261:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806784 00010000:00010000:1.0:1781281097.990270:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 65 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990282:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806848 00010000:00010000:1.0:1781281097.990289:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 62 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990300:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806912 00010000:00010000:1.0:1781281097.990308:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 63 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990318:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807040 00010000:00010000:1.0:1781281097.990325:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 64 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990335:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806976 00010000:00010000:1.0:1781281097.990344:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 65 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990353:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807104 00010000:00010000:1.0:1781281097.990361:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 66 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990371:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806528 00010000:00010000:1.0:1781281097.990380:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 4/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 66 pid: 7752 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990391:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064806592 00010000:00010000:1.0:1781281097.990398:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 67 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990408:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807232 00010000:00010000:1.0:1781281097.990415:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 5/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 68 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990431:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807168 00010000:00010000:1.0:1781281097.990439:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 5/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 69 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281097.990449:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4808 00000100:00100000:1.0:1781281097.990453:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+69:2268:x1867808064806720:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1781281097.990465:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281097.990470:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 69 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.990489:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 69 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281097.990618:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4809 00000100:00100000:0.0:1781281097.990623:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+66:2268:x1867808064806656:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281097.990635:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.990639:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 66 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990649:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 66 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990673:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24b927f/0xce40b48e7cd0220c lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00323 expref: 66 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990688:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990690:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990693:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990700:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 4/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990721:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.990757:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+65:2268:x1867808064806656:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 134us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.990764:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4809 00000100:00100000:0.0:1781281097.990785:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4810 00000100:00100000:0.0:1781281097.990789:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+69:2268:x1867808064806784:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281097.990795:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.990799:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990812:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990826:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0fb36b9/0xce40b48e7cd006b4 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7f4 expref: 69 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990837:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990839:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990841:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990847:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 4/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990861:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.990879:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+68:2268:x1867808064806784:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 89us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.990884:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4810 00000100:00100000:0.0:1781281097.990896:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4811 00000100:00100000:0.0:1781281097.990900:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+64:2268:x1867808064806848:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281097.990907:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.990911:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 64 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990918:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 64 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990936:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8bc216/0xce40b48e7cd01fe3 lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00235 expref: 64 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.990945:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990946:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.990948:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990954:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 4/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.990972:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.990988:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+63:2268:x1867808064806848:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 87us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.990994:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4811 00000100:00100000:0.0:1781281097.991007:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4812 00000100:00100000:0.0:1781281097.991011:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052ad51d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+62:2269:x1867808064806912:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281097.991017:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.991021:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 62 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.991028:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 62 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.991041:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff0eae94/0xce40b48e7cd024c8 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00442 expref: 62 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.991327:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000058cda886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083782080:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281097.991347:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.991379:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.991386:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.991394:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.991400:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.991419:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1781281097.991651:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2375d75/0xce40b48e7cd009f5 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff952 expref: 67 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991661:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991662:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991665:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991672:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 4/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991692:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281097.991717:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+66:2268:x1867808064806720:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 1263us (4377us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281097.991725:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4808 00000100:00100000:1.0:1781281097.991743:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4813 00000100:00100000:1.0:1781281097.991747:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0a01c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+61:2269:x1867808064807040:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1781281097.991757:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281097.991761:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991769:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991782:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb88f684/0xce40b48e7cd01738 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe84 expref: 61 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991790:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991792:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991794:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991800:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 4/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991817:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281097.991834:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0a01c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+60:2269:x1867808064807040:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 86us (4393us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281097.991840:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4813 00000100:00100000:1.0:1781281097.991853:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4814 00000100:00100000:1.0:1781281097.991856:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+59:2269:x1867808064806976:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1781281097.991864:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281097.991868:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 59 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991875:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 59 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991887:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e774a5b/0xce40b48e7cd00ed3 lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb51 expref: 59 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991896:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991898:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.991900:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991906:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 4/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.991923:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281097.991940:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+58:2269:x1867808064806976:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 83us (4487us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281097.991946:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4814 00000100:00100000:1.0:1781281097.991960:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4815 00000100:00100000:1.0:1781281097.991964:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+57:2269:x1867808064807104:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1781281097.991971:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281097.991974:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.991988:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281097.992000:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.992001:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281097.992003:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.992009:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 4/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.992020:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281097.992035:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+57:2269:x1867808064807104:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 71us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281097.992040:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4815 00010000:00010000:0.0:1781281097.992157:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992159:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992161:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992169:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 4/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992187:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.992206:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052ad51d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+56:2269:x1867808064806912:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 1195us (4783us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.992213:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4812 00000100:00100000:0.0:1781281097.992250:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4816 00000100:00100000:0.0:1781281097.992254:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+65:2271:x1867808064806528:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1781281097.992262:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.992266:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 4/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 65 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992275:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 3/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 65 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992291:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003058d2ac/0xce40b48e7cd1d8c0 lrc: 0/0,0 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0932f expref: 65 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992300:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992301:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992303:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992309:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 4/0,1 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992326:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.992339:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+64:2271:x1867808064806528:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 84us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.992345:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4816 00000100:00100000:0.0:1781281097.992358:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4817 00000100:00100000:0.0:1781281097.992362:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+63:2271:x1867808064806592:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1781281097.992369:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.992372:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 63 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992385:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 63 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992398:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928b709d/0xce40b48e7cd0087b lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8b1 expref: 63 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.992407:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992409:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.992410:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992416:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 4/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.992433:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.992447:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+62:2271:x1867808064806592:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 84us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.992453:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4817 00000100:00100000:0.0:1781281097.992465:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4818 00000100:00100000:0.0:1781281097.992469:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+61:2270:x1867808064807232:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1781281097.992486:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1781281097.992490:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 61 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281097.992994:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2284de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3175:x1867808083780608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31574us (31669us total) trans 4294968314 rc 0/0 00000100:00100000:2.0:1781281097.993002:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00010000:00010000:2.0:1781281097.993030:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.993039:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.993046:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993383:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.993389:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993398:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fe691eef already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.993401:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993409:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993426:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 1/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993432:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22485 lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281097.993465:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4819 00000100:00100000:3.0:1781281097.993483:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d952f80d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+61:2271:x1867808064807168:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281097.993505:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281097.993512:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 5/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 61 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.993522:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 61 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281097.993536:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.993537:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281097.993553:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993561:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 4/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993576:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281097.993593:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d952f80d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+61:2271:x1867808064807168:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 123us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281097.993599:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4819 00010000:00010000:3.0:1781281097.993653:0:14276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066ac2378/0xce40b48e7cd00b8b lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa08 expref: 60 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.993665:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022f8bfc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083781120:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.993684:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993692:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993697:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993703:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993709:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.993724:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281097.994011:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c23147e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+22:3178:x1867808083780800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22961us (26893us total) trans 4294968071 rc 0/0 00000100:00100000:3.0:1781281097.994019:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00010000:00010000:1.0:1781281097.994254:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994263:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994270:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994276:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994291:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281097.994438:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000321b98a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3178:x1867808083780864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23841us (29155us total) trans 4294968072 rc 0/0 00000100:00100000:1.0:1781281097.994444:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00010000:00010000:1.0:1781281097.994467:0:7754:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994486:0:7754:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.994493:0:7754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994623:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 59 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.994641:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd1c778 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cc9 expref: 59 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281097.994653:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.994655:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1781281097.994657:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994663:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 4/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994688:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281097.994706:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+58:2270:x1867808064807232:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 2235us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281097.994714:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4818 00010000:00010000:0.0:1781281097.994763:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994770:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994776:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994781:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281097.994788:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1781281097.995528:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.995539:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1781281097.995867:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3178:x1867808083781312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19093us (20134us total) trans 4294968315 rc 0/0 00000100:00100000:2.0:1781281097.995874:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00010000:00010000:2.0:1781281097.995910:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.995918:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.995925:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,1 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.995930:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 2/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.995939:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1781281097.996328:0:7754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281097.996337:0:7754:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000004:00080000:3.0:1781281097.996983:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000006ec8ad43/2, rc 0, transno 1019 00000100:00100000:3.0:1781281097.997000:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ec8ad43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781312:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281097.997014:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000499d901d/2, rc 0, transno 775 00000100:00100000:3.0:1781281097.997022:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000499d901d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780800:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281097.997030:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009896e16a/2, rc 0, transno 776 00000100:00100000:3.0:1781281097.997033:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009896e16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083780864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.997139:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281097.997151:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da99ed28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083782656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.997188:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.997214:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012516b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.997235:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.997249:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022f8bfc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.997266:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281097.997286:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c11f9572/2, rc 0, transno 1018 00000100:00100000:3.0:1781281097.997293:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c11f9572 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.997300:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1781281097.997304:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076b417da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.997321:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.997334:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001e84bfa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281097.997351:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.997377:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782656 00000100:00100000:3.0:1781281097.997407:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782144 00000100:00100000:3.0:1781281097.997420:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782528 00000100:00100000:3.0:1781281097.997433:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782208 00000100:00100000:3.0:1781281097.997445:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782592 00000100:00100000:3.0:1781281097.997455:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:3.0:1781281097.997460:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000945477a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+26:3178:x1867808083782656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.997493:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:242 count 1 00010000:00010000:3.0:1781281097.997524:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997582:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997590:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997592:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997594:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 4/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997618:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997628:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.997638:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083782720:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.997671:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c731fb2 going to sleep for 6 seconds 00000100:00100000:3.0:1781281097.997704:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0fbf7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083782784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.997725:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.997746:0:14239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083782784 00000100:00100000:3.0:1781281097.997762:0:14239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:3.0:1781281097.997766:0:14239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da78fd71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083782144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.997779:0:14239:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:248 count 1 00010000:00010000:3.0:1781281097.997789:0:14239:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997799:0:14239:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997804:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997806:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997807:0:14239:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 4/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997822:0:14239:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997829:0:14239:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.997837:0:14239:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6cf7a71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14239:1867808083782848:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.997855:0:14239:0:(client.c:2500:ptlrpc_set_wait()) set 00000000508c97ef going to sleep for 6 seconds 00000100:00100000:3.0:1781281097.997869:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:3.0:1781281097.997872:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afcd180c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083782528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.997884:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:271 count 1 00010000:00010000:3.0:1781281097.997895:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997905:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 55 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997911:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997912:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.997913:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 4/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997931:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 55 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.997938:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 55 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.997948:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083782912:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.997965:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 0000000046b91887 going to sleep for 43 seconds 00000100:00100000:3.0:1781281097.997980:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:3.0:1781281097.997983:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083782208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.997993:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:265 count 1 00010000:00010000:3.0:1781281097.998003:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998013:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 57 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998019:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998020:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998021:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 4/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998038:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 57 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998046:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 57 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.998054:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083782976:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.998072:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e81d9b15 going to sleep for 6 seconds 00000100:00100000:3.0:1781281097.998086:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:3.0:1781281097.998090:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083782592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281097.998100:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:244 count 1 00010000:00010000:3.0:1781281097.998110:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998121:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998126:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998127:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998128:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 4/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998143:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998150:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.998159:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8137:1867808083783040:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.998175:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eed00176 going to sleep for 6 seconds 00000100:00100000:3.0:1781281097.998189:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:3.0:1781281097.998193:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016b93773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3178:x1867808083782784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.998203:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:274 count 1 00010000:00010000:3.0:1781281097.998213:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998223:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 55 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998228:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998230:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998231:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 4/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998247:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 55 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998254:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 55 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.998261:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc2eebe6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7755:1867808083783104:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.998278:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 000000002a2d9e01 going to sleep for 43 seconds 00010000:00010000:3.0:1781281097.998301:0:14275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171815cf/0xce40b48e7cd02084 lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0027b expref: 55 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.998314:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d572d1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083782016:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281097.998331:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998339:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998344:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998350:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998361:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998370:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1781281097.998750:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006406b574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+27:3175:x1867808083781760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20409us (21282us total) trans 4294968318 rc 0/0 00000100:00100000:3.0:1781281097.998757:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000004:00080000:3.0:1781281097.998787:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000017b45a95/2, rc 0, transno 1022 00000100:00100000:3.0:1781281097.998794:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017b45a95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.998827:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d572d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281097.998846:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281097.998866:0:14275:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783168 00000100:00100000:3.0:1781281097.998880:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1781281097.998883:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1d9319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+27:3175:x1867808083783168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281097.998892:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:257 count 1 00010000:00010000:3.0:1781281097.998903:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998913:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 54 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998918:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998920:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281097.998921:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 4/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998942:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 54 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.998949:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 54 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281097.998956:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be3ca0df pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083783232:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281097.998972:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00010000:00010000:3.0:1781281097.998992:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1781281097.998995:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999002:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002a99d38c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999005:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999012:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999030:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 1/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999036:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a99d38c/0xce40b48e7cd2249a lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999052:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1781281097.999055:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999061:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b273b69e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999063:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999068:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999076:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 1/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999081:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd22493 lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999091:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1781281097.999093:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999098:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf09fd50 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999100:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999104:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999112:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 1/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999120:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf09fd50/0xce40b48e7cd224af lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999130:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1781281097.999132:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999137:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdf2efcd already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999139:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999144:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999152:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 1/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999157:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd224b6 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999168:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1781281097.999171:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 2/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999176:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000944b7559 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999177:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 2/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999188:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 3/0,0 mode: PW/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999195:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 1/0,0 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999200:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2248c lrc: 0/0,0 mode: --/PW res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999211:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281097.999213:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999219:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004fc3437 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999220:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999226:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999233:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 1/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999237:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd224bd lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999246:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281097.999248:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999253:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fab625b9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281097.999255:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999260:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999266:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 1/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999271:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd224cb lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281097.999281:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.999282:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.999283:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281097.999289:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281097.999667:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083780736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29919us (34675us total) trans 4294968073 rc 0/0 00000100:00100000:2.0:1781281097.999677:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00010000:00010000:2.0:1781281097.999703:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.999711:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.999718:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.999723:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281097.999735:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.000040:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3178:x1867808083781952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21296us (21755us total) trans 4294968074 rc 0/0 00000100:00100000:2.0:1781281098.000046:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00010000:00010000:2.0:1781281098.000075:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.000082:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.000087:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.000092:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.000102:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1781281098.000348:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc51e6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3175:x1867808083781376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25311us (25618us total) trans 4294968075 rc 0/0 00000100:00100000:2.0:1781281098.000355:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1781281098.000437:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083782400:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.000456:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.000617:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009f4c6dbc/2, rc 0, transno 778 00000100:00100000:3.0:1781281098.000627:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009f4c6dbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781952:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.000684:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000157bb568/2, rc 0, transno 779 00000100:00100000:3.0:1781281098.000690:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157bb568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781376:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.000701:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004a93075c/2, rc 0, transno 777 00000100:00100000:3.0:1781281098.000703:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a93075c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.000707:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.000717:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000286b2351 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.000746:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.000799:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c996d9a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083783424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.000820:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.000842:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281098.000846:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb275633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083783360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.000867:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.000893:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783296 00000100:00100000:3.0:1781281098.000912:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783424 00000100:00100000:3.0:1781281098.000919:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783360 00000100:00100000:3.0:1781281098.000928:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:3.0:1781281098.000933:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3175:x1867808083783296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.000952:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:277 count 1 00010000:00010000:3.0:1781281098.000969:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.000982:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.000988:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.000990:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.000992:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 4/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001015:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001025:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.001039:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a0eccfa pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083783488:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.001064:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 000000005f8b0e2f going to sleep for 6 seconds 00000100:00100000:3.0:1781281098.001079:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:3.0:1781281098.001083:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c847f2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3178:x1867808083783424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.001094:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:240 count 1 00010000:00010000:3.0:1781281098.001104:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001114:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 57 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001120:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.001121:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.001122:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 4/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001139:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 57 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001146:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 57 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.001155:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f27253a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083783552:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.001172:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eaa4b62f going to sleep for 6 seconds 00010000:00010000:3.0:1781281098.001191:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281098.001195:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001203:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003111fe9e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.001206:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001214:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001229:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 1/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001235:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003111fe9e/0xce40b48e7cd224d2 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001249:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.001250:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001255:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058c50850 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.001257:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001263:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001270:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 1/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001280:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058c50850/0xce40b48e7cd224a8 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.001289:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.001290:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.001291:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.001296:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281098.001454:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b348c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3175:x1867808083781184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25516us (26671us total) trans 4294968317 rc 0/0 00000100:00100000:0.0:1781281098.001462:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:0.0:1781281098.001487:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:0.0:1781281098.001490:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3178:x1867808083783360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281098.001509:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:417 count 1 00010000:00010000:0.0:1781281098.001520:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.001530:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 57 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.001536:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.001538:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.001557:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 4/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.001575:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 57 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.001582:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 57 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.001590:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0a01c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083783616:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.001606:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a2db3983 going to sleep for 6 seconds 00000004:00080000:3.0:1781281098.002181:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000bdc966fd/2, rc 0, transno 1021 00000100:00100000:3.0:1781281098.002191:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bdc966fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083781184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.002229:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008362d394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.002255:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.002314:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783680 00000100:00100000:2.0:1781281098.002333:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:2.0:1781281098.002336:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca3a7fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3175:x1867808083783680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.002348:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:268 count 1 00010000:00010000:2.0:1781281098.002362:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.002374:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.002380:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.002381:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.002382:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 4/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.002398:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.002405:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.002414:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14267:1867808083783744:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.002436:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 000000008af78103 going to sleep for 43 seconds 00000100:00100000:0.0:1781281098.004245:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.004310:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.004379:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8b7e1a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083782464:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.004404:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.005768:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.005788:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.005799:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.005806:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.005832:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.006166:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3178:x1867808083781824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28851us (29043us total) trans 4294968319 rc 0/0 00000100:00100000:2.0:1781281098.006176:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00010000:00010000:2.0:1781281098.006205:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.006210:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006217:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087ec9154 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.006220:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006228:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006249:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 1/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006255:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ec9154/0xce40b48e7cd224c4 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006272:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.006274:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.006275:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.006287:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006294:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006301:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006307:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.006320:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.006712:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093681051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3175:x1867808083780928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31837us (37135us total) trans 4294968076 rc 0/0 00000100:00100000:2.0:1781281098.006719:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:1.0:1781281098.007380:0:7754:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3178:x1867808083781248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30466us (30844us total) trans 4294968316 rc 0/0 00000100:00100000:1.0:1781281098.007390:0:7754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:0.0:1781281098.008713:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.008872:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083782720:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.008898:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.009283:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807296 00010000:00010000:3.0:1781281098.009315:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.009381:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807360 00010000:00010000:3.0:1781281098.009392:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 56 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.009776:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.009851:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807488 00010000:00010000:1.0:1781281098.009869:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.009889:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4820 00000100:00100000:1.0:1781281098.009895:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+56:2270:x1867808064807296:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281098.009912:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.009917:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 56 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.009927:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 56 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.009950:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee4d4f4b/0xce40b48e7cd019a0 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff87 expref: 56 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.009964:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.009966:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.009969:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.009979:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 4/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010004:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.010047:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2270:x1867808064807296:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 152us (5809us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.010054:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4820 00000100:00100000:1.0:1781281098.010173:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4821 00000100:00100000:1.0:1781281098.010177:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+54:2271:x1867808064807360:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281098.010186:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.010190:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 54 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010205:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 54 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010217:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091551a76/0xce40b48e7cd01818 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffedf expref: 54 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010225:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.010227:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.010229:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010235:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 4/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010253:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.010270:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2271:x1867808064807360:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 92us (5960us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.010277:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4821 00000100:00100000:1.0:1781281098.010291:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4822 00000100:00100000:1.0:1781281098.010295:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+58:2270:x1867808064807488:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.010303:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.010306:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010315:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010334:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4ad4de/0xce40b48e7cd00794 lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff84f expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.010343:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.010345:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.010347:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010353:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 4/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010371:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.010388:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+57:2270:x1867808064807488:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 92us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.010394:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4822 00010000:00010000:1.0:1781281098.010416:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010424:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010431:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010436:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.010456:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.010984:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000945477a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+29:3178:x1867808083782656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13522us (13796us total) trans 4294968077 rc 0/0 00000100:00100000:1.0:1781281098.010992:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00010000:00010000:1.0:1781281098.011013:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011022:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011029:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011034:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011041:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1781281098.011329:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b8d9e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3177:x1867808083782336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22120us (22420us total) trans 4294968320 rc 0/0 00000100:00100000:1.0:1781281098.011335:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00010000:00010000:1.0:1781281098.011356:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011364:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011375:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011380:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.011389:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1781281098.011677:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be368255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3177:x1867808083782272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22689us (22821us total) trans 4294968321 rc 0/0 00000100:00100000:1.0:1781281098.011684:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000004:00080000:1.0:1781281098.011727:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000068ffcb28/2, rc 0, transno 1024 00000100:00100000:1.0:1781281098.011740:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068ffcb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083782336:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.011875:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000878e9aed/2, rc 0, transno 1025 00000100:00100000:1.0:1781281098.011883:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000878e9aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083782272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.011919:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f191b70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083783872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.011951:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.011984:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783872 00000100:00100000:1.0:1781281098.012007:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1781281098.012012:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab1fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3177:x1867808083783872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.012032:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:267 count 1 00010000:00010000:1.0:1781281098.012125:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012141:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012153:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.012154:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.012228:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 4/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012254:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012264:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.012274:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083783936:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.012311:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 0000000045175bfd going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.012329:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c7c8001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083783808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.012352:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.012375:0:14266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083783808 00000100:00100000:1.0:1781281098.012394:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1781281098.012397:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a800886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3176:x1867808083783808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.012408:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:265 count 1 00010000:00010000:1.0:1781281098.012419:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012429:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012434:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.012436:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.012437:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 4/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012455:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.012462:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.012482:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001cd763e5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083784000:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.012613:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 000000000eb8e5ae going to sleep for 43 seconds 00010000:00010000:2.0:1781281098.012690:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1781281098.012696:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012705:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003965d60b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.012708:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012716:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012733:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 1/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012740:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd224a1 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012766:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1781281098.012769:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012776:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006dd3f65e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.012778:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012783:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012794:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 1/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012800:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dd3f65e/0xce40b48e7cd224e7 lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012812:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281098.012815:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012821:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e7699bb8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.012822:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012828:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012837:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 1/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012842:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7699bb8/0xce40b48e7cd224e0 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012852:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.012854:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012865:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c473751 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.012867:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012872:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012881:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 1/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012886:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd224d9 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.012896:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.012898:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.012899:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1781281098.013421:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000da99ed28/2, rc 0, transno 781 00000100:00100000:3.0:1781281098.013481:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da99ed28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083782656:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.013611:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002fdd872e/2, rc 0, transno 1023 00000100:00100000:3.0:1781281098.013622:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781824:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281098.013635:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000418c7a9a/2, rc 0, transno 1020 00000100:00100000:3.0:1781281098.013638:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418c7a9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083781248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.013668:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a0eccfa pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083783488:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.013686:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.013713:0:14239:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6cf7a71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14239:1867808083782848:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.013723:0:14239:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.013745:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083782912:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.013754:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.013791:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083782976:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.013800:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.013832:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000e403ae05/2, rc 0, transno 780 00000100:00100000:1.0:1781281098.013930:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4da86eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.013967:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.013998:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784064 00000100:00100000:1.0:1781281098.014024:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1781281098.014028:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000871c5db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+29:3178:x1867808083784064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.014046:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:237 count 1 00010000:00010000:1.0:1781281098.014072:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014083:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014089:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.014091:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.014092:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 4/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014119:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014129:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.014138:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009db642b7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083784192:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.014189:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 0000000001a18e72 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.014277:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.014286:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d00831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083784128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.014308:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.014330:0:7754:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784128 00000100:00100000:1.0:1781281098.014356:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1781281098.014359:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3176:x1867808083784128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.014371:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:266 count 1 00010000:00010000:1.0:1781281098.014382:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014393:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014399:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.014400:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.014402:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 4/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014418:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 52 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.014427:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.014435:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083784256:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.014464:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 000000003f7d0cd4 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.015089:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0a01c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083783616:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.015107:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.015365:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015390:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015412:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015432:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015448:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015460:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015483:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015520:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.015604:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f27253a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083783552:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.015619:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.015650:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8137:1867808083783040:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.015661:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.015683:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc2eebe6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7755:1867808083783104:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.015692:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.015715:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be3ca0df pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083783232:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.015724:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.015739:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.015744:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.015943:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807808 00010000:00010000:1.0:1781281098.015968:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 57 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.015994:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807552 00010000:00010000:1.0:1781281098.016003:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 53 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016014:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807744 00010000:00010000:1.0:1781281098.016021:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 58 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016031:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808000 00010000:00010000:1.0:1781281098.016038:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 59 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016049:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807616 00010000:00010000:1.0:1781281098.016264:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 60 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016280:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807872 00010000:00010000:1.0:1781281098.016292:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 54 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016302:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807424 00010000:00010000:1.0:1781281098.016310:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 55 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016321:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807680 00010000:00010000:1.0:1781281098.016329:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 61 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016340:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064807936 00010000:00010000:1.0:1781281098.016348:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 62 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.016362:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4823 00000100:00100000:1.0:1781281098.016368:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+62:2270:x1867808064807808:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.016380:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.016384:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 62 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016393:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 62 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016417:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5c9ac6/0xce40b48e7cd00c4f lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa55 expref: 62 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016432:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016434:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016437:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016446:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 4/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016483:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.016526:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+61:2270:x1867808064807808:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 157us (6751us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.016533:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4823 00000100:00100000:1.0:1781281098.016574:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4824 00000100:00100000:1.0:1781281098.016578:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2269:x1867808064807552:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281098.016586:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.016590:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016598:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016612:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aeadafc/0xce40b48e7cd0166d lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe30 expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016620:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016622:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016624:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016630:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 4/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016645:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.016662:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+54:2269:x1867808064807552:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 83us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.016668:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4824 00000100:00100000:1.0:1781281098.016681:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4825 00000100:00100000:1.0:1781281098.016685:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+60:2269:x1867808064807744:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281098.016692:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.016695:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 60 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016704:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 60 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016715:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72ca8f0/0xce40b48e7cd1a321 lrc: 0/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08097 expref: 60 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.016724:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016725:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.016727:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016733:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 4/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.016750:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281098.016859:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.016868:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.016877:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.016884:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.016912:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.017197:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+59:2269:x1867808064807744:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 510us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.017204:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4825 00000100:00100000:1.0:1781281098.017218:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4826 00000100:00100000:1.0:1781281098.017223:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbefbd76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+58:2269:x1867808064808000:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281098.017230:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.017234:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.017242:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.017254:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d860636/0xce40b48e7cd0093f lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff905 expref: 58 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.017264:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.017265:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.017267:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.017273:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 4/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.017292:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281098.017373:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.017378:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017385:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a70bad8b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.017388:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017397:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017414:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 1/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017420:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a70bad8b/0xce40b48e7cd22511 lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017436:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.017438:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.017439:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281098.017470:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4827 00000100:00100000:2.0:1781281098.017485:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+57:2269:x1867808064807616:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281098.017494:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.017499:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.017507:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.017519:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f79ed053/0xce40b48e7cd02634 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c004d5 expref: 57 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.017528:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.017530:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.017532:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017538:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 4/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.017594:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.017645:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e403ae05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083780928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.017671:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4828 00000100:00100000:3.0:1781281098.017676:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2269:x1867808064807872:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.017686:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.017690:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 53 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.017704:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 53 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.017718:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008111c8e8/0xce40b48e7cd02148 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002cf expref: 53 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.017727:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.017729:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.017730:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.017737:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 4/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.017754:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281098.018531:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1d9319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+31:3175:x1867808083783168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19643us (19680us total) trans 4294968322 rc 0/0 00000100:00100000:0.0:1781281098.018555:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:0.0:1781281098.018743:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.018766:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.018781:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.018810:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.019354:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbefbd76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+56:2269:x1867808064808000:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 2127us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.019363:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4826 00000100:00100000:1.0:1781281098.019414:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808128 00010000:00010000:1.0:1781281098.019436:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 5/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 53 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.019454:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808064 00010000:00010000:1.0:1781281098.019461:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 5/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.019482:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808192 00010000:00010000:1.0:1781281098.019491:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 5/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 55 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.019502:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808256 00010000:00010000:1.0:1781281098.019509:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 56 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.019523:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4829 00000100:00100000:1.0:1781281098.019527:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+56:2271:x1867808064807424:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1781281098.019539:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.019563:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 56 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019573:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 56 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019593:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f10b15/0xce40b48e7cd023b7 lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003d9 expref: 56 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019606:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.019608:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.019611:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.019619:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 4/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.019647:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.019671:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2271:x1867808064807424:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 143us (4210us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.019678:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4829 00000100:00100000:1.0:1781281098.019690:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4830 00000100:00100000:1.0:1781281098.019694:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2271:x1867808064807680:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.019703:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.019707:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019715:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019728:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000198b1237/0xce40b48e7cd0058e lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff78b expref: 55 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.019737:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.019738:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.019740:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.019746:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 4/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.019951:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281098.020295:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.020326:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+54:2271:x1867808064807680:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 630us (4853us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.020334:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4830 00000100:00100000:1.0:1781281098.020348:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808320 00010000:00010000:1.0:1781281098.020358:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 55 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.020373:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4831 00000100:00100000:1.0:1781281098.020377:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2271:x1867808064807936:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.020385:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.020389:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 53 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020398:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 53 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020411:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084616df3/0xce40b48e7cd01c40 lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0009f expref: 53 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020421:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020422:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020424:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020430:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 4/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020449:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.020467:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+52:2271:x1867808064807936:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 88us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.020483:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4831 00000100:00100000:1.0:1781281098.020497:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4832 00000100:00100000:1.0:1781281098.020500:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef140304 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2271:x1867808064808128:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.020507:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.020511:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 5/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 55 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020518:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 55 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020531:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020533:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020534:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020566:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 4/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020578:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.020597:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef140304 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+55:2271:x1867808064808128:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 96us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.020604:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4832 00000100:00100000:1.0:1781281098.020617:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4833 00000100:00100000:1.0:1781281098.020621:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf779a57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+54:2271:x1867808064808064:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.020628:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.020631:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 5/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020639:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 54 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020651:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020652:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020654:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020659:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 4/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020671:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.020685:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf779a57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+54:2271:x1867808064808064:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 64us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.020690:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4833 00000100:00100000:1.0:1781281098.020702:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4834 00000100:00100000:1.0:1781281098.020706:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2271:x1867808064808192:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.020711:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.020715:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 5/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 53 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020723:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 53 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.020734:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020736:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.020737:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020743:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 4/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.020754:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.020986:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+51:2269:x1867808064807616:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 3499us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.020994:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4827 00000100:00100000:2.0:1781281098.021010:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4835 00000100:00100000:2.0:1781281098.021014:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2271:x1867808064808256:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.021023:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.021026:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 53 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.021035:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 53 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.021048:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.021049:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1781281098.021251:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+53:2271:x1867808064808192:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 544us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.021258:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4834 00000100:00100000:1.0:1781281098.021272:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4836 00000100:00100000:1.0:1781281098.021276:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+52:2271:x1867808064808320:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.021284:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.021288:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.021297:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 52 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.021308:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.021310:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.021312:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021318:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 4/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021328:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.021344:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+52:2271:x1867808064808320:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 68us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.021349:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4836 00010000:00010000:1.0:1781281098.021395:0:14276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061a7ca11/0xce40b48e7cd00311 lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff68f expref: 51 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.021406:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009db642b7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083784192:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.021439:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.021448:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 4/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021486:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 4/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021506:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021513:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021523:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021529:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.021576:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.022019:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c847f2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3178:x1867808083783424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20934us (21198us total) trans 4294968078 rc 0/0 00000100:00100000:1.0:1781281098.022027:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000004:00080000:1.0:1781281098.022223:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c996d9a0/2, rc 0, transno 782 00000100:00100000:1.0:1781281098.022229:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c996d9a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083783424:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1781281098.022273:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001bb8c5d/0xce40b48e7cd01cd3 lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ec expref: 50 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.022284:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001cd763e5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083784000:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.022298:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022305:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022311:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022318:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022323:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022345:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.022703:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a800886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3176:x1867808083783808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10304us (10350us total) trans 4294968323 rc 0/0 00000100:00100000:1.0:1781281098.022710:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00010000:00010000:1.0:1781281098.022730:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022737:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022744:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022749:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.022762:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1781281098.023025:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3175:x1867808083782592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24933us (25672us total) trans 4294968079 rc 0/0 00000100:00100000:1.0:1781281098.023032:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:3.0:1781281098.023210:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+49:2269:x1867808064807872:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 5531us (7760us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.023219:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4828 00010000:00010000:3.0:1781281098.023266:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023274:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023280:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023291:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023300:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1781281098.023483:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+29:3175:x1867808083783296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22539us (22726us total) trans 4294968080 rc 0/0 00000100:00100000:3.0:1781281098.023491:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00010000:00010000:3.0:1781281098.023511:0:14239:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023519:0:14239:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023525:0:14239:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023529:0:14239:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023537:0:14239:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1781281098.023685:0:14239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da78fd71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3175:x1867808083782144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25918us (26449us total) trans 4294968081 rc 0/0 00000100:00100000:3.0:1781281098.023692:0:14239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00010000:00010000:3.0:1781281098.023711:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023719:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023725:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023730:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.023737:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1781281098.024016:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afcd180c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+31:3175:x1867808083782528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26141us (26748us total) trans 4294968324 rc 0/0 00000100:00100000:3.0:1781281098.024022:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00010000:00010000:3.0:1781281098.024040:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024048:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024134:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024140:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024148:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1781281098.024262:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3175:x1867808083782208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26278us (26940us total) trans 4294968082 rc 0/0 00000100:00100000:3.0:1781281098.024269:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000004:00080000:3.0:1781281098.024308:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000286b2351/2, rc 0, transno 784 00000100:00100000:3.0:1781281098.024314:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000286b2351 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783296:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.024327:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009d572d1a/2, rc 0, transno 1026 00000100:00100000:3.0:1781281098.024342:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d572d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783168:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281098.024350:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000076b417da/2, rc 0, transno 786 00000100:00100000:3.0:1781281098.024353:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076b417da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782208:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.024360:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000001e84bfa2/2, rc 0, transno 783 00000100:00100000:3.0:1781281098.024362:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001e84bfa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782592:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.024369:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000012516b00/2, rc 0, transno 785 00000100:00100000:3.0:1781281098.024371:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012516b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782144:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.024378:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000022f8bfc6/2, rc 0, transno 1028 00000100:00100000:3.0:1781281098.024381:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022f8bfc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083782528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.024464:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281098.024487:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000398f68c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.024521:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.024572:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784384 00000100:00100000:3.0:1781281098.024600:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1781281098.024604:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3178:x1867808083784384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.024629:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:273 count 1 00010000:00010000:3.0:1781281098.024652:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024669:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 48 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024681:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.024682:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.024684:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 4/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024709:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 48 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024721:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 48 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.024733:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068983bef pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083784448:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.024771:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 000000008f56e815 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.024784:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.024791:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a0eccfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083784320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.024814:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.024834:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784320 00000100:00100000:3.0:1781281098.024854:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:3.0:1781281098.024857:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+32:3175:x1867808083784320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.024868:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:235 count 1 00010000:00010000:3.0:1781281098.024880:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024890:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 48 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024901:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.024902:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.024903:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 4/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024920:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 48 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.024928:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 48 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.024937:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083784512:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.024958:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1caee80 going to sleep for 43 seconds 00010000:00010000:0.0:1781281098.025074:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1781281098.025079:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025086:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000068d61262 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025089:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025097:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025115:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 1/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025121:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d61262/0xce40b48e7cd2253b lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025137:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1781281098.025141:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025147:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058e1695c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025149:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025154:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025163:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 1/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025169:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd22503 lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025186:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1781281098.025188:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025194:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c79a8a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025196:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025202:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025211:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 1/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025221:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c79a8a0/0xce40b48e7cd22518 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025232:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281098.025235:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025240:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029682757 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025242:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025248:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025256:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 1/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025261:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029682757/0xce40b48e7cd224ee lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025271:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.025273:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025278:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb50e5d2 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025279:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025288:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025296:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 1/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025302:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb50e5d2/0xce40b48e7cd224f5 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025311:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.025312:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025318:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000028ba13bd already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.025320:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025326:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025333:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 1/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025338:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ba13bd/0xce40b48e7cd224fc lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.025347:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.025349:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.025350:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.025479:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1781281098.025484:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025491:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ba94e0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.025493:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025501:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025512:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 1/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025518:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ba94e0/0xce40b48e7cd2251f lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025530:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.025532:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.025533:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.025582:0:14278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b630a1/0xce40b48e7cd01e5b lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0018d expref: 48 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.025593:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083783936:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.025610:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025617:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025623:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025630:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025636:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.025653:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.026004:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab1fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+33:3177:x1867808083783872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13990us (14051us total) trans 4294968325 rc 0/0 00000100:00100000:1.0:1781281098.026012:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00010000:00010000:1.0:1781281098.026037:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026045:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.026216:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004f191b70/2, rc 0, transno 1029 00000100:00100000:3.0:1781281098.026234:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f191b70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083783872:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1781281098.026247:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.026249:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.026256:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081649604 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.026258:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.026265:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.026284:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 1/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.026290:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081649604/0xce40b48e7cd22534 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.026305:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.026306:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.026307:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.026398:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026405:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026451:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.026712:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016b93773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3178:x1867808083782784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28516us (28985us total) trans 4294968326 rc 0/0 00000100:00100000:1.0:1781281098.026719:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00010000:00010000:1.0:1781281098.026741:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026748:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026755:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.026761:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.026815:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009dfb9b17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784576:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.026844:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.026868:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000ba0fbf7b/2, rc 0, transno 1030 00000100:00100000:3.0:1781281098.026877:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0fbf7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083782784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.026916:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0dfc8c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083784640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.026939:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.026965:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784576 00000100:00100000:3.0:1781281098.026987:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784640 00000100:00100000:3.0:1781281098.027003:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1781281098.027007:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091d788d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+34:3178:x1867808083784576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.027024:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:260 count 1 00010000:00010000:3.0:1781281098.027039:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027065:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 47 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027078:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.027079:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.027081:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 4/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027101:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 47 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027111:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 47 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.027120:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083784704:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.027150:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fee38358 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.027166:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1781281098.027170:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065fc3517 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3175:x1867808083784640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.027182:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:238 count 1 00010000:00010000:3.0:1781281098.027192:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027203:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 47 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027208:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.027209:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.027211:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 4/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027230:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 47 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027236:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 47 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.027244:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ab95811 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083784768:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.027267:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 000000003657a488 going to sleep for 43 seconds 00010000:00010000:2.0:1781281098.027433:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.027455:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+47:2271:x1867808064808256:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 6439us (8645us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.027464:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4835 00010000:00010000:2.0:1781281098.027510:0:14267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035f43af4/0xce40b48e7cd01f11 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001da expref: 46 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.027523:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14267:1867808083783744:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.027537:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.027573:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.027578:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.027585:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.027591:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027635:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027643:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027650:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.027655:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027715:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1781281098.027720:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027727:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f4615c42 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.027729:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027736:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027750:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 1/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027756:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd2250a lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027770:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281098.027773:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027779:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc851d66 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.027780:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027786:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027799:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 2/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027805:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.027807:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027812:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e7b3a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.027814:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027820:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027828:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 2/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027834:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.027836:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027840:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ea6efce0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.027841:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027846:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027856:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 2/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.027862:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.027863:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.027864:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.027921:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1781281098.027926:0:14226:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc851d66/0xce40b48e7cd22526 lrc: 0/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.028149:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3178:x1867808083783360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26657us (27281us total) trans 4294968083 rc 0/0 00000100:00100000:1.0:1781281098.028156:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00010000:00010000:1.0:1781281098.028194:0:14262:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78915e5/0xce40b48e7cd01d89 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00132 expref: 45 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.028204:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083784256:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.028215:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028221:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028226:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028238:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028244:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028258:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.028621:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3176:x1867808083784128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14260us (14312us total) trans 4294968327 rc 0/0 00000100:00100000:1.0:1781281098.028629:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00010000:00010000:1.0:1781281098.028649:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.028652:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028659:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a51408a already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.028661:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028668:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028681:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 1/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028687:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a51408a/0xce40b48e7cd22549 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.028704:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.028705:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.028707:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.028880:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1781281098.028902:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b0d00831/2, rc 0, transno 1031 00000100:00100000:1.0:1781281098.028915:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d00831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083784128:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.028927:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009c7c8001/2, rc 0, transno 1027 00000100:00100000:1.0:1781281098.028931:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c7c8001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083783808:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1781281098.029205:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.029288:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1781281098.029294:0:14267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd2252d lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.029715:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281098.029946:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca3a7fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+35:3175:x1867808083783680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27606us (27689us total) trans 4294968328 rc 0/0 00000100:00100000:2.0:1781281098.029957:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1781281098.030305:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c23147e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083784832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.030342:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.030366:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093681051 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.030383:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.030416:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784832 00000100:00100000:1.0:1781281098.030449:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785088 00000100:00100000:1.0:1781281098.030465:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:1.0:1781281098.030481:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3176:x1867808083784832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.030504:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:252 count 1 00010000:00010000:1.0:1781281098.030530:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030577:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030585:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.030588:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.030590:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 4/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030619:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030630:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.030642:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14262:1867808083785280:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.030690:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 000000000ffdbb94 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.030707:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1781281098.030711:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3176:x1867808083785088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.030723:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:271 count 1 00010000:00010000:1.0:1781281098.030734:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030745:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030751:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.030752:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.030753:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 4/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030769:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.030780:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 50 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.030788:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001cd763e5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083785344:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.030809:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 000000006330bf2e going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.030921:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.030930:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b348c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.030955:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.030974:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785024 00000100:00100000:1.0:1781281098.030997:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1781281098.031001:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3176:x1867808083785024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.031011:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:273 count 1 00010000:00010000:1.0:1781281098.031022:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.031036:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 50 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.031042:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.031043:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.031045:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 4/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.031144:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 50 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.031157:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 50 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.031165:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083785408:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.031194:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f12a5250 going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.031319:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1781281098.031325:0:14276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea6efce0/0xce40b48e7cd22542 lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.031640:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc51e6f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.031671:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.031688:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be368255 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.031706:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1781281098.031739:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000cb275633/2, rc 0, transno 787 00000100:00100000:2.0:1781281098.031749:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb275633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083783360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.031759:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1781281098.031763:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000321b98a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.031783:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.031795:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8d9e3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.031812:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.031834:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784960 00000100:00100000:2.0:1781281098.031856:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785216 00000100:00100000:2.0:1781281098.031868:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083784896 00000100:00100000:2.0:1781281098.031878:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785152 00000100:00100000:2.0:1781281098.031890:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:2.0:1781281098.031894:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058cda886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+35:3178:x1867808083784960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.031908:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:278 count 1 00010000:00010000:2.0:1781281098.031921:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.031933:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.031939:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.031941:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.031942:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 4/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.031960:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.031969:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.031978:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d1bb22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083785600:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.032002:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 0000000039f5d647 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.032017:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:2.0:1781281098.032022:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce66c8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3178:x1867808083785216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.032034:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:272 count 1 00010000:00010000:2.0:1781281098.032044:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032134:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032141:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032142:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032143:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 4/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032163:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032171:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 50 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.032180:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b301ab65 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083785664:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.032203:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b0051f16 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.032238:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1781281098.032245:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040bd1c69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.032267:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.032291:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785728 00000100:00100000:2.0:1781281098.032313:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:2.0:1781281098.032317:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d5e1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3178:x1867808083784896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.032328:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:253 count 1 00010000:00010000:2.0:1781281098.032338:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032348:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032355:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032356:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032357:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 4/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032376:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 50 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032384:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.032393:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2c6e3e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083785792:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.032413:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c45e9b91 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.032429:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:2.0:1781281098.032434:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5dc0226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+36:3178:x1867808083785152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.032445:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:254 count 1 00010000:00010000:2.0:1781281098.032455:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032465:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 50 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032481:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032482:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.032484:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 4/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032501:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 50 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.032508:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 50 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.032516:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ea28b72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083785856:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.032535:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 000000008af78103 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.032644:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000871c5db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+35:3178:x1867808083784064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18615us (18677us total) trans 4294968329 rc 0/0 00000100:00100000:3.0:1781281098.032657:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1781281098.032678:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:3.0:1781281098.032683:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063deab88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+36:3178:x1867808083785728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.032694:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:260 count 1 00010000:00010000:3.0:1781281098.032705:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.032715:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.032720:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.032721:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.032723:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 4/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.032739:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 50 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.032747:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 50 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.032754:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083785920:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.032776:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dbe7142c going to sleep for 43 seconds 00010000:00010000:1.0:1781281098.032956:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.032969:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8b7e1a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.032999:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.033023:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.033027:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.033048:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.033153:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785536 00000100:00100000:1.0:1781281098.033173:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083785472 00000100:00100000:1.0:1781281098.033186:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1781281098.033189:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3176:x1867808083785536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.033200:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:236 count 1 00010000:00010000:1.0:1781281098.033212:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033222:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033229:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.033230:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.033231:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 4/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033254:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033263:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.033273:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083785984:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.033295:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d8f97cb3 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.033309:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:1.0:1781281098.033313:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3176:x1867808083785472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.033324:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:410 count 1 00010000:00010000:1.0:1781281098.033427:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: --/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033440:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 2/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 44 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033446:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.033447:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.033448:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 4/0,1 mode: --/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033465:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 3/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 44 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.033484:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 4/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 44 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.033493:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7752:1867808083786048:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.033513:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 000000002e9b6348 going to sleep for 43 seconds 00000004:00080000:0.0:1781281098.033677:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008362d394/2, rc 0, transno 1032 00000100:00100000:0.0:1781281098.033692:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008362d394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083783680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.034013:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.034022:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb2284de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083786112:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281098.034281:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c4da86eb/2, rc 0, transno 1033 00000100:00100000:2.0:1781281098.034299:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4da86eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.034346:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.034590:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.034599:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000050e17a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083786176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.034626:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.034648:0:14266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786112 00000100:00100000:1.0:1781281098.034673:0:14266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786176 00000100:00100000:1.0:1781281098.034686:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1781281098.034690:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095b241ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3177:x1867808083786112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.034705:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:239 count 1 00010000:00010000:1.0:1781281098.034721:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.034733:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 44 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.034740:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.034741:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.034743:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 4/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.034859:0:7754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:2.0:1781281098.034864:0:7754:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3176:x1867808083786176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.034875:0:7754:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:249 count 1 00010000:00010000:2.0:1781281098.034886:0:7754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.034896:0:7754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 44 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.034901:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.034903:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.034904:0:7754:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 4/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.034919:0:7754:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 44 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.034927:0:7754:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 44 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.034935:0:7754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7754:1867808083786240:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.034967:0:7754:0:(client.c:2500:ptlrpc_set_wait()) set 0000000061fe93b0 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.035714:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083784512:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.035734:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.035809:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068983bef pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083784448:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.035824:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036215:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 44 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036226:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.036241:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083786304:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.036289:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 0000000079cc28de going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.036329:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.036400:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.036462:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.036490:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.036511:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808384 00010000:00010000:1.0:1781281098.036533:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 45 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.036575:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808448 00010000:00010000:1.0:1781281098.036584:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 46 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.036595:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808576 00010000:00010000:1.0:1781281098.036602:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 47 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.036612:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808704 00010000:00010000:1.0:1781281098.036620:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 5/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 51 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.036632:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4837 00000100:00100000:1.0:1781281098.036637:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd10e6de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+47:2268:x1867808064808384:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1781281098.036647:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.036651:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 47 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036661:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 47 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036683:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000707b75d/0xce40b48e7cd022f3 lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00385 expref: 47 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036696:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036698:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036700:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036709:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 4/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036729:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.036749:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd10e6de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+46:2268:x1867808064808384:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 112us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.036764:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4837 00000100:00100000:1.0:1781281098.036782:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4838 00000100:00100000:1.0:1781281098.036787:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ce960b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+45:2268:x1867808064808448:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1781281098.036793:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.036797:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 45 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036805:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 45 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036822:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd0016d lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5e0 expref: 45 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036830:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036832:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036833:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036839:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 4/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036852:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.036868:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ce960b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+44:2268:x1867808064808448:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 81us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.036875:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4838 00000100:00100000:1.0:1781281098.036887:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4839 00000100:00100000:1.0:1781281098.036891:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+43:2270:x1867808064808576:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.036898:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.036901:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 43 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036909:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 43 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.036922:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036923:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.036925:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036932:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 4/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.036943:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.036959:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+43:2270:x1867808064808576:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 68us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.036965:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4839 00000100:00100000:1.0:1781281098.036977:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4840 00000100:00100000:1.0:1781281098.036981:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f64ec18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+51:2270:x1867808064808704:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.036988:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.036992:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 5/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 51 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.037001:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 51 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.037014:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.037016:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.037018:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037024:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 4/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037034:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.037050:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f64ec18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+51:2270:x1867808064808704:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 69us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.037139:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4840 00010000:00010000:1.0:1781281098.037187:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037195:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037203:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037209:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037226:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.037712:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a36bb8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3178:x1867808083784384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13105us (13190us total) trans 4294968330 rc 0/0 00000100:00100000:1.0:1781281098.037719:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00010000:00010000:1.0:1781281098.037758:0:7755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b4af715/0xce40b48e7cd02109 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c002b3 expref: 50 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.037769:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001cd763e5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083785344:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.037788:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037795:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037801:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037808:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037814:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.037828:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1781281098.038594:0:14274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000322191a6/0xce40b48e7cd0040d lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6f1 expref: 42 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.038609:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ab95811 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083784768:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.038625:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.038632:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.038637:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.038644:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.038650:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.038670:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1781281098.038863:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065fc3517 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+39:3175:x1867808083784640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11691us (11923us total) trans 4294968331 rc 0/0 00000100:00100000:3.0:1781281098.038871:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1781281098.038905:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083784704:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.038917:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.038954:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f0dfc8c3/2, rc 0, transno 1035 00000100:00100000:3.0:1781281098.038967:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f0dfc8c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083784640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.039020:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.039032:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7ede5eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.039154:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.039189:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786368 00000100:00100000:3.0:1781281098.039217:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:3.0:1781281098.039222:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000de772b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+39:3175:x1867808083786368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.039245:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:247 count 1 00010000:00010000:3.0:1781281098.039264:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039276:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 41 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039283:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.039284:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.039287:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 4/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039309:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 41 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039319:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 41 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.039335:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083786432:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.039372:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fee38358 going to sleep for 6 seconds 00010000:00010000:3.0:1781281098.039389:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1781281098.039393:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039400:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fab625b9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.039403:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039412:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039428:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 1/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039433:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab625b9/0xce40b48e7cd22550 lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039445:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281098.039448:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039453:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ceac6799 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.039455:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039465:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039486:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 1/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039492:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceac6799/0xce40b48e7cd22573 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039507:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.039509:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039515:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdf2efcd already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.039517:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039522:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039531:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 1/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039536:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22565 lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039573:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.039575:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.039576:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.039611:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.039635:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808512 00010000:00010000:3.0:1781281098.039651:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 42 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.039672:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4841 00000100:00100000:3.0:1781281098.039676:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+42:2270:x1867808064808512:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.039687:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.039690:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 42 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.039700:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 42 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.039715:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee295291/0xce40b48e7cd018dc lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff33 expref: 42 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.039723:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.039725:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.039727:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039734:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 4/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039752:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.039773:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+41:2270:x1867808064808512:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.039780:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4841 00010000:00010000:3.0:1781281098.039799:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039806:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039813:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039818:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.039831:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.040001:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091d788d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+40:3178:x1867808083784576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12993us (13156us total) trans 4294968332 rc 0/0 00000100:00100000:3.0:1781281098.040008:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00010000:00010000:3.0:1781281098.040024:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.040027:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.040033:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000944b7559 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.040036:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1781281098.040209:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009dfb9b17/2, rc 0, transno 1036 00000100:00100000:2.0:1781281098.040225:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009dfb9b17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784576:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281098.040237:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000398f68c1/2, rc 0, transno 1034 00000100:00100000:2.0:1781281098.040240:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000398f68c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784384:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1781281098.040333:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040342:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040348:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040353:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040362:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.040523:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+40:3175:x1867808083784320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15663us (15707us total) trans 4294968333 rc 0/0 00000100:00100000:2.0:1781281098.040530:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1781281098.040597:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.040615:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808640 00010000:00010000:2.0:1781281098.040632:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 5/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.040654:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4842 00000100:00100000:2.0:1781281098.040659:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000537e5100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+50:2270:x1867808064808640:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.040668:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.040672:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 5/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.040681:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 50 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.040704:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.040705:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.040707:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040714:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 4/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.040728:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.040747:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000537e5100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+50:2270:x1867808064808640:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.040753:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4842 00000100:00100000:1.0:1781281098.041803:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3176:x1867808083785088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11086us (11414us total) trans 4294968084 rc 0/0 00000100:00100000:1.0:1781281098.041813:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00010000:00010000:1.0:1781281098.041842:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.041847:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041856:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004fc3437 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.041859:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041867:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041881:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 1/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041893:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fc3437/0xce40b48e7cd22557 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041910:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.041911:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.041912:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.041946:0:14262:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009534f68e/0xce40b48e7cd0102a lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbd6 expref: 49 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.041957:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14262:1867808083785280:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.041976:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041984:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041990:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.041997:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.042004:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.042022:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1781281098.042032:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.042034:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.042040:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069b7952d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.042042:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.042048:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.042396:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d1bb22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083785600:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.042413:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.042458:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b301ab65 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083785664:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.042470:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.042524:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2c6e3e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083785792:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.042534:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.042591:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ea28b72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083785856:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.042601:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.042658:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.042680:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808768 00010000:00010000:2.0:1781281098.042702:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 49 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.042726:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4843 00000100:00100000:2.0:1781281098.042731:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea28b72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+49:2268:x1867808064808768:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.042742:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.042747:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 49 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.042764:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 49 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.042784:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.042787:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.042790:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.042797:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 4/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.042812:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.042840:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea28b72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+49:2268:x1867808064808768:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 109us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.042850:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4843 00000100:00100000:2.0:1781281098.042882:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.042897:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808896 00010000:00010000:2.0:1781281098.042907:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 49 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.042925:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4844 00000100:00100000:2.0:1781281098.042929:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c6e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+49:2268:x1867808064808896:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.042937:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.042939:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 49 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.042947:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 49 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.042960:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cc5b6b4/0xce40b48e7cd021cd lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00307 expref: 49 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.042970:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.042971:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.042972:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.042978:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 4/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.042992:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.043005:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c6e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+48:2268:x1867808064808896:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.043012:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4844 00010000:00010000:2.0:1781281098.043027:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.043034:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.043041:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.043047:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043231:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043255:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 1/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043261:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd2255e lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.043356:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ce2078b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.043396:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.043421:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281098.043426:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001aa9f8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.043449:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.043492:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083785920:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.043503:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.043558:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002a0eccfa/2, rc 0, transno 1037 00000100:00100000:3.0:1781281098.043567:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a0eccfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083784320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.043595:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c251b58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.043617:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.043701:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.043721:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809024 00010000:00010000:3.0:1781281098.043735:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 48 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.043754:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4845 00000100:00100000:3.0:1781281098.043759:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+48:2268:x1867808064809024:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.043767:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.043770:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 48 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.043779:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 48 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.043792:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b045034a/0xce40b48e7cd01237 lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffca1 expref: 48 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.043801:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.043803:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.043804:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043811:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 4/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043829:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.043844:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+47:2268:x1867808064809024:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.043849:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4845 00010000:00010000:3.0:1781281098.043870:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043878:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043889:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043895:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.043905:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1781281098.044179:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 1/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044185:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd2256c lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044201:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.044204:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044210:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d3152b9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.044212:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044220:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044229:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 1/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044235:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3152b9/0xce40b48e7cd22596 lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044247:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.044249:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.044250:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.044267:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786560 00000100:00100000:1.0:1781281098.044292:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786496 00000100:00100000:1.0:1781281098.044305:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786624 00000100:00100000:1.0:1781281098.044322:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1781281098.044326:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faf33150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3178:x1867808083786560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.044348:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:244 count 1 00010000:00010000:1.0:1781281098.044367:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044381:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 40 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044388:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044390:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044391:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 4/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044413:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 40 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044423:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 40 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.044438:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083786688:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.044466:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000438be9e4 going to sleep for 6 seconds 00000100:00100000:1.0:1781281098.044493:0:14240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1781281098.044497:0:14240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ef0eb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3178:x1867808083786496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.044510:0:14240:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:245 count 1 00010000:00010000:1.0:1781281098.044520:0:14240:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044531:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 40 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044537:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044538:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044539:0:14240:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 4/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044574:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 40 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044581:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 40 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.044590:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14240:1867808083786752:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.044608:0:14240:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 6 seconds 00000100:00100000:1.0:1781281098.044624:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1781281098.044628:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4fdc14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3175:x1867808083786624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.044642:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:248 count 1 00010000:00010000:1.0:1781281098.044653:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044663:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 40 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044669:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044670:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.044672:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 4/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044688:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 40 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044696:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 40 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.044704:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083786816:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.044721:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 00000000378ead3c going to sleep for 6 seconds 00000100:00100000:1.0:1781281098.044746:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083785984:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.044761:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044793:0:14226:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f347f86f/0xce40b48e7cd02283 lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00354 expref: 46 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.044804:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083785408:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.044816:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044823:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044829:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044835:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044840:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.044853:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1781281098.046035:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1781281098.046903:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3176:x1867808083784832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16428us (16557us total) trans 4294968086 rc 0/0 00000100:00100000:0.0:1781281098.046915:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1781281098.046975:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047005:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047025:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047043:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047215:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047249:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.047280:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281098.047293:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.047297:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047308:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a1c493c7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.047311:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047325:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047344:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 1/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047350:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c493c7/0xce40b48e7cd2257a lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047366:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.047368:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047374:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e7699bb8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.047376:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047382:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047391:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 1/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047397:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22588 lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.047408:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.047410:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.047412:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.047531:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5dc0226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+39:3178:x1867808083785152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15095us (15718us total) trans 4294968087 rc 0/0 00000100:00100000:3.0:1781281098.047562:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:3.0:1781281098.047592:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809152 00010000:00010000:3.0:1781281098.047619:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 41 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047638:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808832 00010000:00010000:3.0:1781281098.047648:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 46 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047660:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064808960 00010000:00010000:3.0:1781281098.047670:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 47 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047681:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809088 00010000:00010000:3.0:1781281098.047691:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 48 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047701:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809216 00010000:00010000:3.0:1781281098.047710:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 5/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 42 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047720:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809280 00010000:00010000:3.0:1781281098.047728:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 5/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 43 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.047738:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809344 00010000:00010000:3.0:1781281098.047746:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00000004:00080000:0.0:1781281098.047882:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009b8d9e3b/2, rc 0, transno 791 00000100:00100000:0.0:1781281098.047896:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8d9e3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.047932:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4846 00000100:00100000:3.0:1781281098.047940:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+44:2268:x1867808064809152:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.047955:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.047961:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.047971:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.047990:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009850d4bc/0xce40b48e7cd0024d lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff63b expref: 44 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048002:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048004:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048008:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048017:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 4/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048047:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281098.048139:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048148:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048165:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048173:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048188:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.048400:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3176:x1867808083785536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15209us (15400us total) trans 4294968334 rc 0/0 00000100:00100000:0.0:1781281098.048408:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00010000:00010000:0.0:1781281098.048427:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.048430:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048437:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f50b7ef4 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.048439:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048450:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048460:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 1/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048466:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50b7ef4/0xce40b48e7cd225a4 lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.048488:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.048490:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.048491:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.048637:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+43:2268:x1867808064809152:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 697us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.048645:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4846 00000100:00100000:3.0:1781281098.048661:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4847 00000100:00100000:3.0:1781281098.048666:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005607813f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+48:2268:x1867808064808832:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.048675:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.048680:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 48 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048689:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 48 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048703:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b926f9be/0xce40b48e7cd027ca lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00561 expref: 48 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048713:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048714:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048716:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048723:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 4/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048749:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.048833:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005607813f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+47:2268:x1867808064808832:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 165us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.048840:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4847 00000100:00100000:3.0:1781281098.048872:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4848 00000100:00100000:3.0:1781281098.048876:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+46:2268:x1867808064808960:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.048882:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.048886:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 46 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048894:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 46 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048906:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff55202/0xce40b48e7cd0112d lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc3f expref: 46 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048915:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048916:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.048918:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048924:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 4/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.048941:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.048954:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+45:2268:x1867808064808960:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 77us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.048958:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4848 00000100:00100000:3.0:1781281098.048971:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4849 00000100:00100000:3.0:1781281098.048975:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+44:2268:x1867808064809088:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.048982:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.048985:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 44 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.048993:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 44 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049003:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4e7b714/0xce40b48e7cd018ce lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff25 expref: 44 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049012:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049013:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049015:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049021:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 4/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049037:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1781281098.049142:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049152:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049223:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049229:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049242:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.049415:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058cda886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+39:3178:x1867808083784960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17519us (17744us total) trans 4294968089 rc 0/0 00000100:00100000:0.0:1781281098.049425:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000004:00080000:0.0:1781281098.049462:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000fc51e6f7/2, rc 0, transno 793 00000100:00100000:0.0:1781281098.049468:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc51e6f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784960:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.049491:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.049495:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049502:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c473751 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.049504:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049511:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049522:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 1/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049528:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c473751/0xce40b48e7cd22581 lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.049560:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.049562:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.049563:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.049599:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+43:2268:x1867808064809088:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 75us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.049608:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4849 00000100:00100000:3.0:1781281098.049622:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4850 00000100:00100000:3.0:1781281098.049626:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+42:2271:x1867808064809216:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.049635:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.049640:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 5/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 42 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049653:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 4/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 42 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049667:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049669:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049671:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049677:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 4/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049689:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.049704:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+42:2271:x1867808064809216:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 78us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.049710:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4850 00000100:00100000:3.0:1781281098.049723:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4851 00000100:00100000:3.0:1781281098.049727:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+41:2271:x1867808064809280:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.049734:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.049738:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 5/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 41 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049746:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 41 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049872:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049874:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049877:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049884:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 4/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049897:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.049913:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+41:2271:x1867808064809280:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 184us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.049919:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4851 00000100:00100000:3.0:1781281098.049932:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4852 00000100:00100000:3.0:1781281098.049936:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+40:2271:x1867808064809344:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281098.049943:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.049947:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 40 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049956:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 40 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.049969:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049970:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.049972:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049978:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 4/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.049989:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.050002:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+40:2271:x1867808064809344:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 66us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.050009:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4852 00010000:00010000:3.0:1781281098.050027:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050035:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050041:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050047:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050138:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.050628:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d5e1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3178:x1867808083784896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18308us (18843us total) trans 4294968090 rc 0/0 00000100:00100000:3.0:1781281098.050635:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000004:00080000:3.0:1781281098.050672:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000321b98a1/2, rc 0, transno 794 00000100:00100000:3.0:1781281098.050677:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000321b98a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083784896:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1781281098.050694:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050703:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050710:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050716:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.050725:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281098.051048:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063deab88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+39:3178:x1867808083785728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18365us (18780us total) trans 4294968091 rc 0/0 00000100:00100000:3.0:1781281098.051137:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000004:00080000:3.0:1781281098.051243:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000040bd1c69/2, rc 0, transno 795 00000100:00100000:3.0:1781281098.051248:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040bd1c69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.052349:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce66c8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+38:3178:x1867808083785216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20324us (20640us total) trans 4294968088 rc 0/0 00000100:00100000:2.0:1781281098.052361:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00010000:00010000:2.0:1781281098.052406:0:7754:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006832cc9c/0xce40b48e7cd00d52 lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffac5 expref: 39 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.052422:0:7754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7754:1867808083786240:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.052443:0:7754:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.052452:0:7754:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.052462:0:7754:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.052469:0:7754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.052488:0:7754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.052499:0:7754:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1781281098.052752:0:7754:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3176:x1867808083786176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17886us (18125us total) trans 4294968335 rc 0/0 00000100:00100000:2.0:1781281098.052771:0:7754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:3.0:1781281098.052934:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000537e5100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.052970:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.053012:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000be368255/2, rc 0, transno 792 00000100:00100000:3.0:1781281098.053024:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be368255 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083785216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.053034:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281098.053038:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d1bb22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786944:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.053174:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281098.053180:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053189:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003965d60b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.053192:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053200:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053219:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 1/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053226:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd2258f lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053242:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.053244:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053250:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b273b69e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.053252:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053259:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053267:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 1/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053273:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b273b69e/0xce40b48e7cd2259d lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053292:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.053294:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053300:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eac9999e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.053302:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053307:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053315:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 1/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053320:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd225b9 lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053331:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.053332:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.053333:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.053426:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.053462:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ea28b72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.053499:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.053516:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.053520:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b301ab65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.053535:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.053579:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787008 00000100:00100000:3.0:1781281098.053608:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786944 00000100:00100000:3.0:1781281098.053621:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787072 00000100:00100000:3.0:1781281098.053633:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083786880 00000100:00100000:3.0:1781281098.053649:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:3.0:1781281098.053654:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3178:x1867808083787008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.053683:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:236 count 1 00010000:00010000:3.0:1781281098.053705:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.053722:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 42 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.053730:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.053733:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.053735:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 4/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.053857:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:0.0:1781281098.053861:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+41:3178:x1867808083786944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281098.053874:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:264 count 1 00010000:00010000:0.0:1781281098.053886:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053896:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053902:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.053903:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.053904:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 4/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053922:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.053933:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.053943:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e1c24d81 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083787136:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.053992:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e0151ac4 going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.054130:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 42 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.054138:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 42 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.054146:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d566d31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083787200:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.054265:0:7754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1781281098.054270:0:7754:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d16d0357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3175:x1867808083787072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.054283:0:7754:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:274 count 1 00010000:00010000:2.0:1781281098.054296:0:7754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.054308:0:7754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 42 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.054314:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.054315:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.054317:0:7754:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 4/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.054337:0:7754:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 42 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.054344:0:7754:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 42 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.054352:0:7754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083787264:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.054390:0:7754:0:(client.c:2500:ptlrpc_set_wait()) set 000000000a1c1216 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.054518:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 0000000046b91887 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.054538:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1781281098.054571:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c3cab2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3175:x1867808083786880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.054583:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:436 count 1 00010000:00010000:3.0:1781281098.054593:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.054607:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 42 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.054614:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.054615:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.054617:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 4/0,1 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.054635:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 3/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 42 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.054642:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 4/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 42 pid: 7752 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.054651:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089885e18 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083787328:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.054676:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.054960:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cab17534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083787392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.054996:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.055075:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000050e17a1/2, rc 0, transno 1039 00000100:00100000:3.0:1781281098.055092:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000050e17a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083786176:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281098.055108:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000e8b7e1a5/2, rc 0, transno 1038 00000100:00100000:3.0:1781281098.055111:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8b7e1a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785536:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281098.055123:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c23147e4/2, rc 0, transno 790 00000100:00100000:3.0:1781281098.055132:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c23147e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083784832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.055306:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1781281098.055318:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008503c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.055343:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.055588:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3176:x1867808083785024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24584us (24632us total) trans 4294968085 rc 0/0 00000100:00100000:1.0:1781281098.055596:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:2.0:1781281098.055718:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1781281098.056902:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.056907:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.056909:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1781281098.056949:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000093681051/2, rc 0, transno 788 00000100:00100000:2.0:1781281098.056958:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093681051 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785088:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1781281098.056980:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000001b348c11/2, rc 0, transno 789 00000100:00100000:2.0:1781281098.056983:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b348c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785024:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.057288:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2c6e3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.057327:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.057567:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787392 00000100:00100000:1.0:1781281098.057601:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787456 00000100:00100000:1.0:1781281098.057620:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1781281098.057624:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000557d0576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3176:x1867808083787392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.057651:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:235 count 1 00010000:00010000:1.0:1781281098.057676:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.057695:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 42 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.057705:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.057706:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.057709:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 4/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.057740:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 42 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.057751:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.057770:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083787648:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.057821:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 000000009baace38 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.059531:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1781281098.059556:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6965cce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+42:3178:x1867808083787456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.059583:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:237 count 1 00010000:00010000:1.0:1781281098.059604:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059618:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 42 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059625:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.059627:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.059629:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 4/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059663:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 42 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059672:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 42 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.059684:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083787712:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.059733:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 000000009721c3a6 going to sleep for 43 seconds 00010000:00010000:1.0:1781281098.059821:0:7752:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3e0e8c/0xce40b48e7cd18fd3 lrc: 0/0,0 mode: --/PW res: [0x19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07a46 expref: 38 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.059836:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7752:1867808083786048:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.059852:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059860:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059866:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059872:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,1 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059878:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 2/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.059896:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.060380:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3176:x1867808083785472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27064us (27330us total) trans 4294968336 rc 0/0 00000100:00100000:1.0:1781281098.060389:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00010000:00010000:1.0:1781281098.060510:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.060514:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 2/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060523:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da730b65 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.060526:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 2/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060534:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 3/0,0 mode: PW/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060569:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 1/0,0 mode: --/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060575:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd225ab lrc: 0/0,0 mode: --/PW res: [0x19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060589:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.060591:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.060592:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.060619:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006acbf694/0xce40b48e7cd004ed lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff74c expref: 37 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.060634:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083786304:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.060646:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060653:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060658:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060663:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060669:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.060684:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.060821:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095b241ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3177:x1867808083786112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26129us (26475us total) trans 4294968337 rc 0/0 00000100:00100000:1.0:1781281098.060828:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1781281098.060957:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083786688:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.060969:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.061228:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14240:1867808083786752:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.061240:0:14240:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.061283:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083786816:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.061293:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.061386:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.061408:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809792 00010000:00010000:1.0:1781281098.061431:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 5/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 43 pid: 7752 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.061456:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4853 00000100:00100000:1.0:1781281098.061461:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+43:2268:x1867808064809792:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1781281098.061588:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e1c24d81 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14275:1867808083787136:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.061602:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.061759:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083786432:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.061772:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.061795:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089885e18 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083787328:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.061808:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.061827:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.061874:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000bb2284de/2, rc 0, transno 1041 00000100:00100000:3.0:1781281098.061885:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb2284de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083786112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.061934:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.061941:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.061972:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.062022:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bbef9f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083787840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.062043:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.062135:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.062140:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0c44b46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083787904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.062160:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.062195:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787520 00000100:00100000:3.0:1781281098.062219:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787584 00000100:00100000:3.0:1781281098.062235:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787776 00000100:00100000:3.0:1781281098.062248:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787840 00000100:00100000:3.0:1781281098.062257:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083787904 00000100:00100000:3.0:1781281098.062265:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1781281098.062269:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015da3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+45:3178:x1867808083787520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.062292:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:243 count 1 00010000:00010000:3.0:1781281098.062313:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062327:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 36 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062334:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062336:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062337:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 4/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062359:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 36 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062369:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 36 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.062378:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000845cd941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083787968:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.062419:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.062436:0:14239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1781281098.062440:0:14239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089885e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3175:x1867808083787584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.062453:0:14239:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:246 count 1 00010000:00010000:3.0:1781281098.062463:0:14239:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062483:0:14239:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 36 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062490:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062491:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062493:0:14239:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 4/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062513:0:14239:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 36 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062520:0:14239:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 36 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.062529:0:14239:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083788032:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.062578:0:14239:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fee38358 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.062592:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:3.0:1781281098.062596:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1786cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3175:x1867808083787776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.062606:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:253 count 1 00010000:00010000:3.0:1781281098.062617:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062627:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 36 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062633:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062635:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.062636:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 4/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062651:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 36 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.062657:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 36 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.062664:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083788096:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.062684:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 000000002a2d9e01 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.066237:0:7754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083787264:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.066268:0:7754:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.066407:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:2.0:1781281098.066416:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c5c7381 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+44:3177:x1867808083787840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.066451:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:258 count 1 00010000:00010000:2.0:1781281098.066489:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.066505:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 43 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.066518:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.066520:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.066522:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 4/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.066583:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 43 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.066594:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 43 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.066608:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c847f2ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083788160:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.066670:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 0000000036c81028 going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.067031:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.067042:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 4/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 43 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.067143:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 3/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 43 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.067166:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000823ce9a5/0xce40b48e7cd1de70 lrc: 0/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c09558 expref: 43 pid: 7752 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.067180:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.067182:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.067185:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067193:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 4/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067217:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.067249:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e3c20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+42:2268:x1867808064809792:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 5787us (5863us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.067259:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4853 00010000:00010000:1.0:1781281098.067298:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067306:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067314:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067320:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067336:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.067648:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c3cab2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3175:x1867808083786880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13076us (14112us total) trans 4294968092 rc 0/0 00000100:00100000:1.0:1781281098.067656:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:1.0:1781281098.067673:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1781281098.067678:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cd28084 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3177:x1867808083787904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.067696:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:238 count 1 00010000:00010000:1.0:1781281098.067711:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067722:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 41 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067729:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.067730:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.067732:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 4/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067751:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 41 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067759:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 41 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.067769:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083788224:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.067793:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.067805:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281098.067811:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067819:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009314175e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.067822:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067830:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067849:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 1/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067855:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd225b2 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067870:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.067872:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067877:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aecaec52 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.067879:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067885:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 3/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067892:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 1/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067897:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aecaec52/0xce40b48e7cd225f1 lrc: 0/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.067906:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.067908:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.067909:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.067988:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.068008:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809408 00010000:00010000:1.0:1781281098.068027:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 37 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.068048:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4854 00000100:00100000:3.0:1781281098.068196:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d566d31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083787200:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.068213:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1781281098.068240:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b301ab65/2, rc 0, transno 796 00000100:00100000:3.0:1781281098.068249:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b301ab65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.068293:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ab95811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.068317:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.068365:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000806fe980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+37:2270:x1867808064809408:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.068376:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.068380:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 37 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.068390:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 37 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.068404:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b675f57/0xce40b48e7cd00bca lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa1d expref: 37 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.068415:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.068416:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.068419:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068425:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 4/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068449:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.068467:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000806fe980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2270:x1867808064809408:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 104us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.068483:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4854 00000100:00100000:1.0:1781281098.068528:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788288 00000100:00100000:1.0:1781281098.068626:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1781281098.068630:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d566d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3175:x1867808083788288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.068645:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:239 count 1 00010000:00010000:1.0:1781281098.068658:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068669:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 41 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068675:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.068677:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.068678:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 4/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068695:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 41 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.068704:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 41 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.068712:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083788352:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.068736:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 0000000079cc28de going to sleep for 6 seconds 00000100:00100000:2.0:1781281098.068859:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.068883:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.068897:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809536 00010000:00010000:2.0:1781281098.068909:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.068926:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809664 00010000:00010000:2.0:1781281098.068933:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.068947:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4855 00000100:00100000:2.0:1781281098.068951:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2270:x1867808064809536:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.068958:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.068961:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.068969:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.068981:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003259456/0xce40b48e7cd00a81 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff98a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.068992:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.068993:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.068994:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069001:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 4/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069019:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069035:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+35:2270:x1867808064809536:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 83us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069042:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4855 00000100:00100000:2.0:1781281098.069065:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4856 00000100:00100000:2.0:1781281098.069069:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+42:2270:x1867808064809664:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.069076:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069079:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069087:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069100:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b4dd1d7/0xce40b48e7cd01b8a lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00059 expref: 42 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069108:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069110:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069111:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069118:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 4/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069135:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069149:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+41:2270:x1867808064809664:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069154:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4856 00000100:00100000:2.0:1781281098.069184:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.069196:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809856 00010000:00010000:2.0:1781281098.069204:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 41 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.069219:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4857 00000100:00100000:2.0:1781281098.069223:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+41:2270:x1867808064809856:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281098.069229:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069231:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 41 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069246:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 41 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069257:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df0b34d/0xce40b48e7cd001ac lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff5fc expref: 41 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069266:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069267:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069269:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069275:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 4/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069287:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069301:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+40:2270:x1867808064809856:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069306:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4857 00000100:00100000:2.0:1781281098.069331:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.069342:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809472 00010000:00010000:2.0:1781281098.069350:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.069364:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4858 00000100:00100000:2.0:1781281098.069368:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006406b574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+35:2270:x1867808064809472:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.069373:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069376:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069384:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069395:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000910a0665/0xce40b48e7cd009a1 lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff92f expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069404:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069405:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069407:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069413:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 4/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069426:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069438:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006406b574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+34:2270:x1867808064809472:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 70us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069444:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4858 00000100:00100000:2.0:1781281098.069467:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.069495:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809600 00010000:00010000:2.0:1781281098.069504:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 34 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.069520:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4859 00000100:00100000:2.0:1781281098.069523:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+34:2270:x1867808064809600:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.069532:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069535:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 34 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069566:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 34 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069580:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012aea1f5/0xce40b48e7cd00c8e lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffa71 expref: 34 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069589:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069590:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069592:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069597:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 4/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069612:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069628:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2270:x1867808064809600:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 104us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069634:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4859 00000100:00100000:2.0:1781281098.069663:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.069676:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809728 00010000:00010000:2.0:1781281098.069687:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 40 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.069704:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4860 00000100:00100000:2.0:1781281098.069709:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+40:2270:x1867808064809728:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.069715:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069718:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 40 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069725:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 40 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069739:0:14243:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fa64209/0xce40b48e7cd02347 lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003af expref: 40 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069749:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069750:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069753:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069759:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 4/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069775:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069791:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2270:x1867808064809728:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 81us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069797:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4860 00000100:00100000:2.0:1781281098.069858:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.069871:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809984 00010000:00010000:2.0:1781281098.069881:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 39 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.069901:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4861 00000100:00100000:2.0:1781281098.069905:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a9dd393 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2270:x1867808064809984:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281098.069912:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.069915:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 39 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069922:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 39 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.069935:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069936:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.069938:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069944:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 4/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.069955:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.069966:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a9dd393 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2270:x1867808064809984:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.069972:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4861 00000100:00100000:2.0:1781281098.070101:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.070116:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064809920 00010000:00010000:2.0:1781281098.070127:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 39 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.070150:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4862 00000100:00100000:2.0:1781281098.070153:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2270:x1867808064809920:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281098.070160:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.070163:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 39 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.070171:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 39 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.070183:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.070185:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.070187:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.070192:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 4/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.070203:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.070216:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2270:x1867808064809920:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.070222:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4862 00010000:00010000:3.0:1781281098.070440:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070455:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070463:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070469:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070502:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.070793:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000de772b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+46:3175:x1867808083786368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31569us (31639us total) trans 4294968338 rc 0/0 00000100:00100000:3.0:1781281098.070801:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00010000:00010000:3.0:1781281098.070823:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070830:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070837:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070842:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.070851:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281098.071284:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3178:x1867808083787008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17629us (18313us total) trans 4294968093 rc 0/0 00000100:00100000:3.0:1781281098.071292:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000004:00080000:3.0:1781281098.071341:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f7ede5eb/2, rc 0, transno 1042 00000100:00100000:3.0:1781281098.071353:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7ede5eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.071401:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.071412:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.071444:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.071480:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788416 00000100:00100000:3.0:1781281098.071504:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:3.0:1781281098.071508:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3175:x1867808083788416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.071527:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:241 count 1 00010000:00010000:3.0:1781281098.071566:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071580:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 32 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071587:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.071588:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.071590:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 4/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071624:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 32 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071635:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.071652:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff06a644 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14248:1867808083788480:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.071679:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eaa4b62f going to sleep for 43 seconds 00000004:00080000:3.0:1781281098.071709:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000537e5100/2, rc 0, transno 797 00000100:00100000:3.0:1781281098.071719:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000537e5100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.071763:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1cc9db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.071786:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.071816:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788544 00000100:00100000:3.0:1781281098.071838:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1781281098.071841:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f102fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+46:3177:x1867808083788544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.071852:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:263 count 1 00010000:00010000:3.0:1781281098.071865:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071876:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 38 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071882:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.071883:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.071885:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 4/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071905:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 38 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071913:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 38 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.071923:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083788608:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.071942:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 000000005f8b0e2f going to sleep for 6 seconds 00010000:00010000:3.0:1781281098.071963:0:7754:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071971:0:7754:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071978:0:7754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071983:0:7754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.071992:0:7754:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1781281098.072136:0:7754:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d16d0357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3175:x1867808083787072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17865us (18637us total) trans 4294968094 rc 0/0 00000100:00100000:3.0:1781281098.072143:0:7754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000004:00080000:3.0:1781281098.072171:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000006ea28b72/2, rc 0, transno 798 00000100:00100000:3.0:1781281098.072179:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ea28b72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.072210:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.072217:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006743c856 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.072237:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.072264:0:7754:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788672 00000100:00100000:3.0:1781281098.072285:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:3.0:1781281098.072289:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d43769d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3177:x1867808083788672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.072301:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:261 count 1 00010000:00010000:3.0:1781281098.072312:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.072323:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 38 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.072328:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.072329:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.072330:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 4/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.072346:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 38 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.072354:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 38 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.072362:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d984b3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083788736:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.072379:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dbe7142c going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.072718:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072728:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072741:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072747:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072755:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1781281098.072912:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4fdc14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3175:x1867808083786624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28282us (29294us total) trans 4294968339 rc 0/0 00000100:00100000:1.0:1781281098.072919:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00010000:00010000:1.0:1781281098.072940:0:14240:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072948:0:14240:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072954:0:14240:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072960:0:14240:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.072967:0:14240:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1781281098.073152:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1781281098.073157:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073165:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002a99d38c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.073168:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073177:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073193:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 1/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073199:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a99d38c/0xce40b48e7cd225c0 lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073212:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1781281098.073215:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073221:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006d032266 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.073222:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073228:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073234:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 1/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073239:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d032266/0xce40b48e7cd225dc lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073255:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1781281098.073257:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073262:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e7b3a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.073264:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073269:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073277:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 1/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073283:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd225ea lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073293:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281098.073295:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073300:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003af10635 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.073302:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073307:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073320:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 1/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073325:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af10635/0xce40b48e7cd225d5 lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073336:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.073337:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073342:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003d9d0481 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.073344:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073350:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073357:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 1/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073362:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d9d0481/0xce40b48e7cd225ce lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.073373:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.073374:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.073375:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.073701:0:14240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ef0eb31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3178:x1867808083786496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29201us (30250us total) trans 4294968340 rc 0/0 00000100:00100000:1.0:1781281098.073708:0:14240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00010000:00010000:1.0:1781281098.073732:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.073741:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.073748:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.073753:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.073767:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.074039:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faf33150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3178:x1867808083786560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29711us (30642us total) trans 4294968341 rc 0/0 00000100:00100000:1.0:1781281098.074045:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000004:00080000:3.0:1781281098.074199:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000003c251b58/2, rc 0, transno 1043 00000100:00100000:3.0:1781281098.074209:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c251b58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083786624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.074253:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004e8451f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.074278:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.074300:0:14240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788800 00000100:00100000:3.0:1781281098.074322:0:14240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:3.0:1781281098.074327:0:14240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9db967c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3175:x1867808083788800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.074344:0:14240:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:240 count 1 00010000:00010000:3.0:1781281098.074359:0:14240:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074372:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 32 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074380:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.074381:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.074383:0:14240:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 4/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074402:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 32 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074411:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.074420:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14240:1867808083788864:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.074443:0:14240:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1caee80 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.074524:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000845cd941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083787968:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.074554:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.074598:0:14239:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083788032:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.074609:0:14239:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.074662:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.074681:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.074698:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810112 00010000:00010000:3.0:1781281098.074714:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.074737:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810240 00010000:00010000:3.0:1781281098.074749:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 5/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 39 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.074769:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4863 00000100:00100000:3.0:1781281098.074774:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078020e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810112:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.074783:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.074787:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.074796:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.074814:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab94067/0xce40b48e7cd00b06 lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff9c9 expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.074825:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.074827:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.074829:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074841:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 4/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074860:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.074874:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078020e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+32:2269:x1867808064810112:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.074881:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4863 00000100:00100000:3.0:1781281098.074895:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4864 00000100:00100000:3.0:1781281098.074898:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad065030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2269:x1867808064810240:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.074905:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.074908:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 5/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 39 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.074917:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 39 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.074930:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.074931:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.074933:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074939:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 4/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074950:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.074962:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad065030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+39:2269:x1867808064810240:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.074969:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4864 00010000:00010000:3.0:1781281098.074987:0:14239:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.074993:0:14239:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.075000:0:14239:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.075006:0:14239:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.075015:0:14239:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1781281098.075187:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000001aa9f8c/2, rc 0, transno 1044 00000100:00100000:2.0:1781281098.075197:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001aa9f8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281098.075208:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004ce2078b/2, rc 0, transno 1045 00000100:00100000:2.0:1781281098.075211:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ce2078b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1781281098.075235:0:14276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac385df/0xce40b48e7cd0171c lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffe6f expref: 38 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.075245:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c847f2ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083788160:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.075257:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.075265:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.075270:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.075276:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.075282:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.075290:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1781281098.075679:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c5c7381 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+48:3177:x1867808083787840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9264us (13635us total) trans 4294968095 rc 0/0 00000100:00100000:2.0:1781281098.075687:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00010000:00010000:1.0:1781281098.075788:0:14277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd002af lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff66c expref: 37 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.075802:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083787712:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.075819:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.075827:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.075832:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.075844:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.075850:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.075858:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1781281098.076252:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.076261:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.076267:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.076277:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.076285:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1781281098.076712:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6965cce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+49:3178:x1867808083787456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17171us (21368us total) trans 4294968096 rc 0/0 00000100:00100000:1.0:1781281098.076720:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00010000:00010000:1.0:1781281098.076750:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1781281098.076754:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076762:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000959bd900 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.076765:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076773:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076789:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 1/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076794:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000959bd900/0xce40b48e7cd225c7 lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076814:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1781281098.076816:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076822:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000044c8b9a already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.076824:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076829:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076838:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 1/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076843:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000044c8b9a/0xce40b48e7cd2260d lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076854:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1781281098.076857:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076863:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000074ed0297 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.076865:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076870:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076884:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 1/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076890:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ed0297/0xce40b48e7cd2261b lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076902:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281098.076904:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076909:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003ca58c5 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.076911:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076916:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076923:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 1/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076928:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd225ff lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076938:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.076940:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076950:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d22d3bbf already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.076952:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076958:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076966:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 1/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076972:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22d3bbf/0xce40b48e7cd225e3 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.076983:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.076985:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.076986:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.077010:0:14226:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d33180f/0xce40b48e7cd000b7 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff59a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.077019:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083787648:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.077033:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077041:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.077142:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+48:3178:x1867808083786944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23279us (23716us total) trans 4294968097 rc 0/0 00000100:00100000:0.0:1781281098.077150:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00010000:00010000:1.0:1781281098.077193:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077200:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077205:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077226:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.077368:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000557d0576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3176:x1867808083787392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19743us (22372us total) trans 4294968098 rc 0/0 00000100:00100000:1.0:1781281098.077375:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1781281098.077577:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.077606:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810048 00010000:00010000:1.0:1781281098.077627:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.077651:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4865 00000100:00100000:1.0:1781281098.077655:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+32:2269:x1867808064810048:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1781281098.077668:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.077672:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.077682:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.077703:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c29d89/0xce40b48e7cd008cf lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff8d4 expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.077714:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.077716:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.077719:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077727:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 4/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077748:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.077763:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6451f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+31:2269:x1867808064810048:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 107us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.077770:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4865 00010000:00010000:1.0:1781281098.077791:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077798:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077805:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077811:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.077824:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.077972:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015da3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+48:3178:x1867808083787520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15701us (20644us total) trans 4294968342 rc 0/0 00000100:00100000:1.0:1781281098.077979:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:1.0:1781281098.078038:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281098.078170:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.078174:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078182:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a51408a already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.078185:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078190:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078201:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 1/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078206:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a51408a/0xce40b48e7cd225f8 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078220:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.078222:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078231:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002efa5f28 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.078233:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078238:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078247:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 1/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078252:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efa5f28/0xce40b48e7cd22606 lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.078264:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.078265:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.078267:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.078568:0:14239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089885e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3175:x1867808083787584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16126us (16741us total) trans 4294968343 rc 0/0 00000100:00100000:3.0:1781281098.078576:0:14239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1781281098.078679:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810176 00010000:00010000:3.0:1781281098.078695:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 5/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 31 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.078718:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4866 00000100:00100000:3.0:1781281098.078723:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+31:2269:x1867808064810176:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.078733:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.078736:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 5/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 31 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.078751:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 31 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.078766:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.078767:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.078769:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.078775:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 4/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.078788:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.078801:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+31:2269:x1867808064810176:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 78us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.078807:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4866 00000100:00100000:3.0:1781281098.078834:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d5fdac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.078865:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.078897:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000003bbef9f3/2, rc 0, transno 799 00000100:00100000:3.0:1781281098.078907:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bbef9f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083787840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.078928:0:14239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788992 00000100:00100000:3.0:1781281098.078949:0:14239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1781281098.078953:0:14239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096c12348 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3177:x1867808083788992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.078973:0:14239:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:242 count 1 00010000:00010000:3.0:1781281098.078991:0:14239:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079009:0:14239:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079016:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.079017:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.079018:0:14239:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 4/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079038:0:14239:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079048:0:14239:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.079146:0:14239:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083789056:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.079171:0:14239:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.079209:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.079217:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b9ba9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.079241:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.079260:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789120 00000100:00100000:3.0:1781281098.079283:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:3.0:1781281098.079287:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e444468c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+48:3177:x1867808083789120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.079299:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:269 count 1 00010000:00010000:3.0:1781281098.079311:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079321:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 35 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079327:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.079328:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.079330:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 4/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079346:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 35 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079355:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 35 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.079363:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092018bde pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083789184:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.079381:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 0000000077d727a5 going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.079409:0:14262:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ab8781b/0xce40b48e7cd011f8 lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc85 expref: 30 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.079421:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083788096:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.079434:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079442:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079448:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079458:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079464:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079488:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1781281098.079498:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.079501:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079507:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ba94e0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.079510:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079516:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079527:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 1/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079533:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd22614 lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.079594:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.079595:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.079597:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.079930:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1786cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3175:x1867808083787776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17333us (17957us total) trans 4294968344 rc 0/0 00000100:00100000:3.0:1781281098.079937:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00010000:00010000:1.0:1781281098.080338:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.080344:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.080360:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075ce134d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083788928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.080387:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1781281098.080489:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000cab17534/2, rc 0, transno 802 00000100:00100000:1.0:1781281098.080503:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cab17534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083787392:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1781281098.080566:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f18c39a5/2, rc 0, transno 1040 00000100:00100000:1.0:1781281098.080576:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f18c39a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083785472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.080609:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.080631:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.080645:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.080651:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.080670:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.080695:0:14275:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083788928 00000100:00100000:1.0:1781281098.080722:0:14277:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789312 00000100:00100000:1.0:1781281098.080737:0:14277:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789248 00000100:00100000:1.0:1781281098.080752:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:1.0:1781281098.080757:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3176:x1867808083788928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.080773:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:234 count 1 00010000:00010000:1.0:1781281098.080791:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080805:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080811:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.080813:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.080814:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 4/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080834:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080843:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.080852:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011fa024f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083789376:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.080882:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 00000000be409de1 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.080898:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:1.0:1781281098.080902:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3176:x1867808083789312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.080915:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:279 count 1 00010000:00010000:1.0:1781281098.080925:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080936:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080942:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.080944:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.080945:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 4/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080962:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.080969:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.080978:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c3ba4b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083789440:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.080999:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e2e9045c going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.081014:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:1.0:1781281098.081018:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3176:x1867808083789248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.081030:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:270 count 1 00010000:00010000:1.0:1781281098.081042:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1781281098.081303:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000030badc11/2, rc 0, transno 1048 00000100:00100000:0.0:1781281098.081314:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787776:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1781281098.081324:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000012a9343/2, rc 0, transno 1047 00000100:00100000:0.0:1781281098.081327:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000012a9343 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083787584:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1781281098.081506:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 35 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.081515:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.081517:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.081518:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 4/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.081538:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 35 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.081651:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.081660:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d6b34d8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083789504:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.081726:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d50f4e37 going to sleep for 43 seconds 00000004:00080000:2.0:1781281098.081868:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000008503c74/2, rc 0, transno 800 00000100:00100000:2.0:1781281098.081883:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008503c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.084213:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d34b60a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.084272:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.084314:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.084320:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001483d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.084337:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1781281098.084380:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000089d1bb22/2, rc 0, transno 801 00000100:00100000:3.0:1781281098.084386:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d1bb22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083786944:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.084397:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f2c6e3e6/2, rc 0, transno 1046 00000100:00100000:3.0:1781281098.084406:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2c6e3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083787520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.084430:0:14262:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789568 00000100:00100000:3.0:1781281098.084467:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789632 00000100:00100000:3.0:1781281098.084494:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1781281098.084498:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000306d8604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3177:x1867808083789568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.084521:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:436 count 1 00010000:00010000:3.0:1781281098.084566:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.084582:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.084588:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.084590:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.084592:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 4/0,1 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.084622:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 3/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.084632:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 4/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.084642:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eaef2af pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14226:1867808083789696:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.084729:0:14275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1781281098.084734:0:14275:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b36b7248 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+52:3177:x1867808083789632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.084747:0:14275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:429 count 1 00010000:00010000:2.0:1781281098.084758:0:14275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.084767:0:14275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 29 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.084772:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.084774:0:14275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.084775:0:14275:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 4/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.084792:0:14275:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 29 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.084798:0:14275:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.084805:0:14275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006406b574 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083789760:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.087620:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 000000002a2d9e01 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.087997:0:14275:0:(client.c:2500:ptlrpc_set_wait()) set 00000000df03be1f going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.088466:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.088504:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810368 00010000:00010000:2.0:1781281098.088536:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.088596:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4867 00000100:00100000:2.0:1781281098.088602:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2269:x1867808064810368:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.088615:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.088619:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.088629:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.088653:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.088655:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.088658:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.088667:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 4/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.088686:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.088725:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2269:x1867808064810368:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 122us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.088732:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4867 00000100:00100000:2.0:1781281098.088770:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.088785:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810496 00010000:00010000:2.0:1781281098.088796:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.088818:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4868 00000100:00100000:2.0:1781281098.088823:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1ddfff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2269:x1867808064810496:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.088830:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.088833:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.088841:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 36 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.088856:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.088857:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.088859:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.088866:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 4/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.088877:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.088892:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1ddfff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+36:2269:x1867808064810496:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.088898:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4868 00000100:00100000:2.0:1781281098.088966:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.088979:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810624 00010000:00010000:2.0:1781281098.088990:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 5/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.089012:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4869 00000100:00100000:2.0:1781281098.089015:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+30:2269:x1867808064810624:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.089023:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.089026:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 5/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.089034:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.089047:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.089048:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.089187:0:14240:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b49940a/0xce40b48e7cd00698 lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff7df expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.089202:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14240:1867808083788864:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.089235:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.089244:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 4/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089393:0:7755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa29409/0xce40b48e7cd00414 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ff expref: 35 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.089404:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083788352:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.089418:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089428:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089434:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089443:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089449:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.089466:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.089742:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d566d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3175:x1867808083788288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21109us (21423us total) trans 4294968099 rc 0/0 00000100:00100000:0.0:1781281098.089749:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000004:00080000:0.0:1781281098.089788:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008ab95811/2, rc 0, transno 803 00000100:00100000:0.0:1781281098.089794:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ab95811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281098.090361:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f12aa75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083789824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281098.090399:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1781281098.090455:0:14240:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 4/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.090499:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083788224:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.090511:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090535:0:14274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf46981a/0xce40b48e7cd01b0c lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0001a expref: 34 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.090561:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083788608:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.090570:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090577:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090584:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090590:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090597:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.090610:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281098.090971:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f102fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+50:3177:x1867808083788544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19127us (19184us total) trans 4294968100 rc 0/0 00000100:00100000:3.0:1781281098.090979:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1781281098.091000:0:14274:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789824 00000100:00100000:3.0:1781281098.091023:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:3.0:1781281098.091027:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c24d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+53:3175:x1867808083789824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.091045:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:278 count 1 00010000:00010000:2.0:1781281098.091378:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.091412:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810624:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 2394us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.091421:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4869 00000100:00100000:2.0:1781281098.091590:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.091612:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810304 00010000:00010000:2.0:1781281098.091628:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 34 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.091655:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4870 00000100:00100000:2.0:1781281098.091660:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+34:2269:x1867808064810304:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.091668:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.091672:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 34 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.091681:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 34 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.091701:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403d3673/0xce40b48e7cd00350 lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff6ab expref: 34 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.091713:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.091715:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.091718:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091727:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 4/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091747:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.091763:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810304:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 103us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.091770:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4870 00010000:00010000:2.0:1781281098.091786:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091797:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091804:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091810:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.091824:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1781281098.092171:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092186:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 28 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092197:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.092199:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.092200:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 4/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092225:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 28 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092234:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 28 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.092246:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083789952:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.092281:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1caee80 going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.092296:0:14240:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092303:0:14240:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092310:0:14240:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092316:0:14240:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.092324:0:14240:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1781281098.093037:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cd28084 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3177:x1867808083787904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25355us (30873us total) trans 4294968101 rc 0/0 00000100:00100000:2.0:1781281098.093047:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:2.0:1781281098.093190:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.093222:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810432 00010000:00010000:2.0:1781281098.093246:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 5/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.093270:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4871 00000100:00100000:2.0:1781281098.093275:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810432:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.093286:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.093290:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 5/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093300:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093326:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093328:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093330:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093338:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 4/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093353:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.093373:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810432:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.093380:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4871 00000100:00100000:2.0:1781281098.093424:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.093441:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810560 00010000:00010000:2.0:1781281098.093453:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 5/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.093483:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4872 00000100:00100000:2.0:1781281098.093487:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810560:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.093495:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.093498:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 5/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093507:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093524:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093525:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093527:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093533:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 4/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093564:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.093580:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810560:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.093586:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4872 00000100:00100000:2.0:1781281098.093628:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.093643:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810688 00010000:00010000:2.0:1781281098.093654:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 5/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.093670:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4873 00000100:00100000:2.0:1781281098.093674:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000945477a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810688:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.093681:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.093684:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 5/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093691:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093709:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093710:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.093712:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093718:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 4/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.093728:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.093744:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000945477a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810688:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.093751:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4873 00000100:00100000:2.0:1781281098.093925:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.093938:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810752 00010000:00010000:2.0:1781281098.093950:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 5/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.093967:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4874 00000100:00100000:2.0:1781281098.093971:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810752:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.093979:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.093983:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 5/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.093992:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 33 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.094010:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.094012:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.094014:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.094020:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 4/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.094031:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.094048:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2269:x1867808064810752:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.096280:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4874 00000100:00100000:2.0:1781281098.096385:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.096424:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810880 00010000:00010000:2.0:1781281098.096452:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 5/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.096494:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4875 00000100:00100000:2.0:1781281098.096500:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ae70630 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810880:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.096516:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.096521:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 5/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.096532:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 29 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.096580:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.096582:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.096585:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.096594:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 4/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.096614:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.096649:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ae70630 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810880:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 149us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.096656:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4875 00000100:00100000:2.0:1781281098.096735:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.096751:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810816 00010000:00010000:2.0:1781281098.096763:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.096782:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4876 00000100:00100000:2.0:1781281098.096786:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810816:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.096793:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.096796:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.096804:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 29 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.096823:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.096825:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.096827:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.096834:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 4/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.096847:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.096864:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f305529c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2269:x1867808064810816:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.096870:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4876 00000100:00100000:2.0:1781281098.096955:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.096969:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064810944 00010000:00010000:2.0:1781281098.096982:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.097001:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4877 00000100:00100000:2.0:1781281098.097005:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2271:x1867808064810944:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281098.097012:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.097015:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.097023:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 33 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.097043:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.097045:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.097047:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.097220:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 4/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.097234:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.097253:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef69984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+33:2271:x1867808064810944:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 247us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.097259:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4877 00000100:00100000:2.0:1781281098.097301:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.097317:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811008 00010000:00010000:2.0:1781281098.097329:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 5/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.097348:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4878 00000100:00100000:2.0:1781281098.097352:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2271:x1867808064811008:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281098.097359:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.097363:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 5/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.097371:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 4/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 29 pid: 14261 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.097383:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.097385:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.097387:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.097394:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 4/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.097405:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.097421:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a90157d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2271:x1867808064811008:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.097427:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4878 00010000:00010000:1.0:1781281098.097633:0:14244:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c141555a/0xce40b48e7cd029c9 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0061e expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.097649:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c3ba4b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083789440:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.097667:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.097677:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.097682:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.097690:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.097696:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.097707:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1781281098.098273:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3176:x1867808083789312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17369us (17640us total) trans 4294968346 rc 0/0 00000100:00100000:1.0:1781281098.098282:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00010000:00010000:1.0:1781281098.098335:0:14261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec427762/0xce40b48e7cd02045 lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0025f expref: 32 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.098348:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d6b34d8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083789504:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.098363:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098370:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098374:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098380:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098385:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098393:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1781281098.098588:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3176:x1867808083789248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17569us (17918us total) trans 4294968102 rc 0/0 00000100:00100000:1.0:1781281098.098595:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00010000:00010000:1.0:1781281098.098621:0:14277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f73a07b9/0xce40b48e7ccfffad lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff53f expref: 27 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.098636:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011fa024f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083789376:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.098646:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098652:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098657:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098663:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098668:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098675:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1781281098.098872:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+55:3176:x1867808083788928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18113us (18484us total) trans 4294968347 rc 0/0 00000100:00100000:1.0:1781281098.098879:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00010000:00010000:1.0:1781281098.098953:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1781281098.098959:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098967:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069b7952d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.098970:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098977:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098992:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 1/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.098998:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22629 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.099012:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1781281098.099014:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.099021:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cdf2efcd already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.099023:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.099029:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.099037:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 1/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.099043:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf2efcd/0xce40b48e7cd22637 lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.099170:0:14240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9db967c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3175:x1867808083788800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24841us (24890us total) trans 4294968345 rc 0/0 00000100:00100000:3.0:1781281098.099177:0:14240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00010000:00010000:3.0:1781281098.099209:0:15268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e69bf30/0xce40b48e7cd01f81 lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0020b expref: 31 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.099219:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092018bde pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083789184:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.099230:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099237:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099242:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099248:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099254:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099262:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1781281098.099390:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e444468c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+50:3177:x1867808083789120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20102us (20149us total) trans 4294968103 rc 0/0 00000100:00100000:3.0:1781281098.099395:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00010000:00010000:3.0:1781281098.099425:0:14248:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007167b144/0xce40b48e7cd00786 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff83a expref: 26 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.099440:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff06a644 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14248:1867808083788480:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.099450:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099456:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099462:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099467:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099485:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099493:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1781281098.099620:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3175:x1867808083788416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28111us (28176us total) trans 4294968348 rc 0/0 00000100:00100000:3.0:1781281098.099626:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00010000:00010000:3.0:1781281098.099641:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1781281098.099645:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099651:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cbdb2393 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099653:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099659:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099669:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 1/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099675:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbdb2393/0xce40b48e7cd22622 lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099688:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1781281098.099690:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099695:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f4615c42 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099697:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099702:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099711:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 1/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099716:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4615c42/0xce40b48e7cd22645 lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099727:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1781281098.099730:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099735:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005d15d38 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099737:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099743:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099750:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 1/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099755:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005d15d38/0xce40b48e7cd22661 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099765:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1781281098.099767:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099772:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087ca9abb already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099774:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099778:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099786:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 1/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099796:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ca9abb/0xce40b48e7cd22668 lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099808:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1781281098.099810:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099814:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c65f687 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099816:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099821:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099829:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 1/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099833:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c65f687/0xce40b48e7cd2265a lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099844:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1781281098.099847:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099853:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb50e5d2 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099855:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099865:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099873:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 1/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099878:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22653 lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099892:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.099894:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099900:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000944b7559 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.099901:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099907:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099915:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 1/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099920:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944b7559/0xce40b48e7cd22630 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099930:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.099931:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.099933:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.099954:0:14239:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073eef9fa/0xce40b48e7cd00819 lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff887 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.099961:0:14239:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083789056:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.099971:0:14239:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099977:0:14239:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099983:0:14239:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099989:0:14239:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.099994:0:14239:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.100010:0:14239:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.100233:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.100258:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811072 00010000:00010000:2.0:1781281098.100281:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 5/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.100305:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4879 00000100:00100000:2.0:1781281098.100309:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+25:2271:x1867808064811072:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1781281098.100322:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.100326:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 5/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.100334:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.100350:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.100352:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.100355:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100366:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 4/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100383:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.100412:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074cc6eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+25:2271:x1867808064811072:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.100417:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4879 00010000:00010000:2.0:1781281098.100444:0:14275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2685176/0xce40b48e7cd1c794 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08cd7 expref: 24 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.100453:0:14275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006406b574 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14275:1867808083789760:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.100462:0:14275:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100468:0:14275:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100485:0:14275:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100491:0:14275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100496:0:14275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.100507:0:14275:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1781281098.100740:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281098.100744:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100751:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000028ba13bd already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.100753:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100761:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100772:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 1/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100778:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ba13bd/0xce40b48e7cd2264c lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100790:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.100792:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100798:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000045ac1e68 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.100800:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100806:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100814:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 1/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100824:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ac1e68/0xce40b48e7cd22676 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.100835:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.100836:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.100838:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.100855:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d6b34d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.100893:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.100929:0:14248:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790080 00000100:00100000:1.0:1781281098.100951:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1781281098.100955:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c3ba4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3178:x1867808083790080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.100975:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:267 count 1 00010000:00010000:1.0:1781281098.100996:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101008:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101015:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101016:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101018:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 4/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101045:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101141:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.101153:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083790144:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.101185:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 6 seconds 00000100:00100000:1.0:1781281098.101199:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1781281098.101207:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011fa024f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.101228:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.101246:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790016 00000100:00100000:1.0:1781281098.101264:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:1.0:1781281098.101267:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+51:3178:x1867808083790016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.101279:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:275 count 1 00010000:00010000:1.0:1781281098.101290:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101300:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 30 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101305:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101307:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101308:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 4/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101324:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 30 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101332:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 30 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.101346:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083790208:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.101369:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 0000000079cc28de going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.101386:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.101533:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.101578:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811136 00010000:00010000:1.0:1781281098.101595:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 5/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 24 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.101616:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4880 00000100:00100000:1.0:1781281098.101621:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010b1addb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+24:2271:x1867808064811136:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281098.101630:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281098.101633:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 5/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 24 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.101642:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 24 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.101660:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.101661:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281098.101663:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101670:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 4/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101683:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.101702:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010b1addb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+24:2271:x1867808064811136:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 81us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.101709:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4880 00000100:00100000:1.0:1781281098.101789:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d648dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.101813:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.101832:0:14277:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083789888 00000100:00100000:1.0:1781281098.101850:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1781281098.101854:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f1e1dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:3176:x1867808083789888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.101868:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:268 count 1 00010000:00010000:1.0:1781281098.101880:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101891:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101897:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101899:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.101900:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 4/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101916:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.101924:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.101932:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083790272:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.101958:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 000000009721c3a6 going to sleep for 6 seconds 00000004:00080000:1.0:1781281098.102003:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000dd10e6de/2, rc 0, transno 806 00000100:00100000:1.0:1781281098.102014:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd10e6de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789248:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1781281098.102185:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004e8451f3/2, rc 0, transno 1049 00000100:00100000:0.0:1781281098.102202:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004e8451f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788800:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1781281098.102214:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008aea4e0e/2, rc 0, transno 1052 00000100:00100000:0.0:1781281098.102217:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008aea4e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083788416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1781281098.102227:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281098.102253:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281098.102282:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790336 00000100:00100000:0.0:1781281098.102304:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:0.0:1781281098.102308:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3175:x1867808083790336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281098.102320:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:251 count 1 00010000:00010000:0.0:1781281098.102332:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.102343:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.102349:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.102350:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.102352:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 4/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.102367:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 30 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.102374:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.102382:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7677f1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083790400:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.102406:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bd54e48e going to sleep for 6 seconds 00000100:00100000:0.0:1781281098.102502:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781281098.108612:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1781281098.108641:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca6451f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.108734:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.108798:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790528 00000100:00100000:1.0:1781281098.108835:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:1.0:1781281098.108840:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3178:x1867808083790528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.108870:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:255 count 1 00010000:00010000:1.0:1781281098.109148:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109167:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 23 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109174:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109176:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109178:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 4/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109212:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 23 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109223:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 23 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.109233:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083790592:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.109268:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 000000009baace38 going to sleep for 43 seconds 00000004:00080000:1.0:1781281098.109350:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000965a84c7/2, rc 0, transno 1050 00000100:00100000:1.0:1781281098.109358:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000965a84c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.109389:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a36bb8b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.109405:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.109418:0:14244:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790656 00000100:00100000:1.0:1781281098.109444:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:1.0:1781281098.109447:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3178:x1867808083790656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.109456:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:276 count 1 00010000:00010000:1.0:1781281098.109464:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109484:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 23 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109491:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109492:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109493:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 4/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109513:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 23 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109521:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 23 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.109529:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083790720:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.109572:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 000000002e9b6348 going to sleep for 43 seconds 00000100:00100000:0.0:1781281098.109605:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790464:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.109630:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000075ce134d/2, rc 0, transno 1051 00000100:00100000:0.0:1781281098.109635:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.109637:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075ce134d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083788928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.109670:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871c5db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.109691:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.109787:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790464 00000100:00100000:3.0:1781281098.109851:0:14239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096c12348 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3177:x1867808083788992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30897us (30986us total) trans 4294968349 rc 0/0 00000100:00100000:2.0:1781281098.109853:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790784 00000100:00100000:3.0:1781281098.109859:0:14239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1781281098.109877:0:14239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1781281098.109880:0:14239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3175:x1867808083790464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.109887:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1781281098.109890:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+57:3175:x1867808083790784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.109892:0:14239:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:254 count 1 00002000:00080000:1.0:1781281098.109901:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:264 count 1 00010000:00010000:3.0:1781281098.109903:0:14239:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109909:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.109912:0:14239:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 23 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.109918:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109918:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 23 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.109920:0:14239:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.109921:0:14239:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 4/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109924:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109926:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.109927:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 4/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.109938:0:14239:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 23 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.109939:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 23 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.109946:0:14239:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 23 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:1.0:1781281098.109946:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 23 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.109956:0:14239:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083790848:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.109956:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083790912:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.114018:0:14239:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eaa4b62f going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.114047:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.114301:0:14274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6b734e/0xce40b48e7cd028e9 lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005c3 expref: 23 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.114324:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14274:1867808083789952:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.114346:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114356:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114363:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114372:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114379:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114406:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.114727:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c24d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+58:3175:x1867808083789824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23697us (24326us total) trans 4294968350 rc 0/0 00000100:00100000:3.0:1781281098.114737:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00010000:00010000:3.0:1781281098.114780:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5658e36/0xce40b48e7cd01961 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfff6b expref: 30 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.114792:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d984b3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083788736:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.114803:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114810:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114816:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114828:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114834:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.114847:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1781281098.115243:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.115249:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115257:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c79a8a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.115260:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115268:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115289:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 1/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115296:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c79a8a0/0xce40b48e7cd2267d lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115311:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.115314:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115319:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fab625b9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.115321:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115326:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115335:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 1/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115346:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fab625b9/0xce40b48e7cd2263e lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.115356:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.115358:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.115359:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.115736:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d43769d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3177:x1867808083788672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43443us (43496us total) trans 4294968104 rc 0/0 00000100:00100000:3.0:1781281098.115745:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00010000:00010000:3.0:1781281098.115783:0:14226:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aeddf0e/0xce40b48e7cd1e1c6 lrc: 0/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0967e expref: 22 pid: 14261 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.115794:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eaef2af pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14226:1867808083789696:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.115809:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.115816:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.115822:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.115828:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,1 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.115839:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.115858:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1781281098.116248:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b1b9ba9f/2, rc 0, transno 807 00000100:00100000:2.0:1781281098.116262:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b9ba9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789120:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1781281098.116276:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000005d5fdac3/2, rc 0, transno 1053 00000100:00100000:2.0:1781281098.116285:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d5fdac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788992:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281098.116344:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000006743c856/2, rc 0, transno 808 00000100:00100000:2.0:1781281098.116348:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006743c856 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788672:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1781281098.116359:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d1cc9db9/2, rc 0, transno 804 00000100:00100000:2.0:1781281098.116362:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1cc9db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083788544:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1781281098.116372:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b0c44b46/2, rc 0, transno 805 00000100:00100000:2.0:1781281098.116375:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0c44b46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083787904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.116557:0:14275:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b36b7248 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3177:x1867808083789632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31805us (32201us total) trans 4294968352 rc 0/0 00000100:00100000:2.0:1781281098.116566:0:14275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000004:00080000:2.0:1781281098.116591:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000001483d93/2, rc 0, transno 1056 00000100:00100000:2.0:1781281098.116598:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001483d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.116638:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000945477a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.116671:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.116701:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791040 00000100:00100000:2.0:1781281098.116730:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:2.0:1781281098.116737:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+59:3177:x1867808083791040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.116765:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:409 count 1 00010000:00010000:2.0:1781281098.116788:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: --/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.116804:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 2/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 21 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.116812:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.116814:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.116816:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 4/0,1 mode: --/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.116839:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 3/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 21 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.116850:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 4/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 21 pid: 14239 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.116860:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da78fd71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083791104:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.116902:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e7a2223c going to sleep for 43 seconds 00010000:00010000:0.0:1781281098.117003:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.117018:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.117027:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000029682757 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.117029:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 2/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.117036:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 3/0,0 mode: PW/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.117061:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 1/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.117067:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029682757/0xce40b48e7cd2266f lrc: 0/0,0 mode: --/PW res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.117082:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.117083:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.117085:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.117241:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000306d8604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3177:x1867808083789568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32741us (32970us total) trans 4294968351 rc 0/0 00000100:00100000:3.0:1781281098.117248:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000004:00080000:2.0:1781281098.117351:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000003d34b60a/2, rc 0, transno 1055 00000100:00100000:2.0:1781281098.117367:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d34b60a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083789568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.117441:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1781281098.118171:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.118197:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.118215:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.118231:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.118273:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811200 00010000:00010000:3.0:1781281098.118297:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 30 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.118323:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811328 00010000:00010000:3.0:1781281098.118333:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 31 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.118344:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811264 00010000:00010000:3.0:1781281098.118353:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 5/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 32 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.118364:0:14243:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811392 00010000:00010000:3.0:1781281098.118374:0:14243:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 5/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 22 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.118393:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4881 00000100:00100000:3.0:1781281098.118398:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d984b3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+32:2271:x1867808064811200:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.118410:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.118414:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 32 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118423:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 32 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118444:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118446:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118449:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118457:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 4/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118485:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.118519:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d984b3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+32:2271:x1867808064811200:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.118526:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4881 00000100:00100000:3.0:1781281098.118561:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4882 00000100:00100000:3.0:1781281098.118565:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a099efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+31:2271:x1867808064811328:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.118573:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.118579:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 31 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118589:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 31 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118601:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118602:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118604:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118610:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 4/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118621:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.118637:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a099efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+31:2271:x1867808064811328:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 72us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.118644:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4882 00000100:00100000:3.0:1781281098.118681:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4883 00000100:00100000:3.0:1781281098.118685:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002819e6c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+30:2271:x1867808064811264:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.118692:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.118696:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 5/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118704:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 30 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118718:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118719:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118722:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118728:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 4/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118739:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.118756:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002819e6c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+30:2271:x1867808064811264:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 69us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.118762:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4883 00000100:00100000:3.0:1781281098.118774:0:14243:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4884 00000100:00100000:3.0:1781281098.118777:0:14243:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2271:x1867808064811392:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.118786:0:14243:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.118789:0:14243:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 5/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 22 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118797:0:14243:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 22 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.118810:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118811:0:14243:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.118813:0:14243:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118819:0:14243:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 4/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.118830:0:14243:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.118845:0:14243:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2271:x1867808064811392:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 66us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.118851:0:14243:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4884 00000100:00100000:1.0:1781281098.119068:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 00000000438be9e4 going to sleep for 43 seconds 00010000:00010000:1.0:1781281098.119104:0:15268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ade4c8/0xce40b48e7cd02412 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c003f5 expref: 29 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.119118:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083790208:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.119136:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119144:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119150:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119158:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119164:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119181:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.119436:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+54:3178:x1867808083790016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18166us (18206us total) trans 4294968105 rc 0/0 00000100:00100000:1.0:1781281098.119444:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00010000:00010000:1.0:1781281098.119492:0:14261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce0a655e/0xce40b48e7cd01421 lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd57 expref: 21 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.119502:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083790592:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.119513:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119521:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119527:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119533:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119562:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.119576:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.119937:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a01549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3178:x1867808083790528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11095us (11204us total) trans 4294968353 rc 0/0 00000100:00100000:1.0:1781281098.119944:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00010000:00010000:1.0:1781281098.119980:0:14277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000273435d7/0xce40b48e7cd01ebd lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c001b7 expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.119992:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14277:1867808083790272:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.120005:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120011:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120021:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120027:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120033:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120041:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1781281098.120155:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f1e1dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+54:3176:x1867808083789888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18300us (18341us total) trans 4294968106 rc 0/0 00000100:00100000:1.0:1781281098.120162:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1781281098.120190:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083790144:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.120200:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1781281098.120235:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000000f12aa75/2, rc 0, transno 1054 00000100:00100000:1.0:1781281098.120244:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f12aa75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083789824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.120250:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781281098.120260:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006406b574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.120292:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.120319:0:14277:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083790976 00000100:00100000:1.0:1781281098.120342:0:14277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:1.0:1781281098.120346:0:14277:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000042b1fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+59:3175:x1867808083790976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.120368:0:14277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:415 count 1 00010000:00010000:1.0:1781281098.120388:0:14277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: --/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120402:0:14277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 2/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 20 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120409:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.120411:0:14277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.120413:0:14277:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 4/0,1 mode: --/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120441:0:14277:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 3/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 20 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.120451:0:14277:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 4/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 20 pid: 14274 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.120462:0:14277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083791232:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.120509:0:14277:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 6 seconds 00000100:00100000:2.0:1781281098.120732:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2d5e1ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.120762:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.120779:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eaef2af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.120795:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.120823:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791424 00000100:00100000:2.0:1781281098.120845:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791168 00000100:00100000:2.0:1781281098.120859:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:2.0:1781281098.120863:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afcd180c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+54:3177:x1867808083791424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.120875:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:233 count 1 00010000:00010000:2.0:1781281098.120887:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.120899:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 27 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.120905:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.120906:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.120908:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 4/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.120925:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 27 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.120933:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 27 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.120942:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016b93773 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083791488:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.120965:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000d2812a going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.120979:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:2.0:1781281098.120983:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3177:x1867808083791168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.120995:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:252 count 1 00010000:00010000:2.0:1781281098.121005:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.121015:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 20 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.121021:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.121022:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.121024:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 4/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.121041:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 20 pid: 7755 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.121262:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.121286:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811456 00010000:00010000:3.0:1781281098.121301:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.121322:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4885 00000100:00100000:3.0:1781281098.121326:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+28:2271:x1867808064811456:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.121335:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.121338:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.121348:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.121366:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003390fe71/0xce40b48e7cd01df9 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00163 expref: 28 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.121376:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.121378:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.121380:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121387:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 4/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121412:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.121432:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+27:2271:x1867808064811456:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 105us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.121438:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4885 00010000:00010000:3.0:1781281098.121457:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121463:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121482:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121488:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.121498:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1781281098.121699:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c3ba4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3178:x1867808083790080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20743us (20806us total) trans 4294968107 rc 0/0 00000100:00100000:3.0:1781281098.121707:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1781281098.121926:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d5dc0226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.121957:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.121981:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063deab88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.122002:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.122019:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781281098.122024:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000058cda886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.122043:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.122186:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d984b3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083791616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.122208:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1781281098.122258:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 20 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.122272:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083791552:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.122311:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 000000001a4b0011 going to sleep for 6 seconds 00010000:00010000:0.0:1781281098.122431:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1781281098.122437:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122445:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000959bd900 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.122448:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122455:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122483:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 1/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122489:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000959bd900/0xce40b48e7cd2268b lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122505:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281098.122507:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122513:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009314175e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.122515:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122521:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122531:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 1/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122570:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009314175e/0xce40b48e7cd226a0 lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122582:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.122584:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122590:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004b3e4625 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.122592:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122598:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122606:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 1/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122611:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3e4625/0xce40b48e7cd22692 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122623:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.122625:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122631:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003ca58c5 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.122633:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122644:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122652:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 1/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122658:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ca58c5/0xce40b48e7cd22684 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122668:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.122670:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.122671:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.122700:0:7755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049dc6fd7/0xce40b48e7cd00ee1 lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffb5f expref: 26 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.122710:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7677f1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083790400:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.122727:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122736:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122742:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122748:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122755:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.122768:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.123224:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3175:x1867808083790336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20913us (20969us total) trans 4294968108 rc 0/0 00000100:00100000:0.0:1781281098.123233:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000004:00080000:1.0:1781281098.123554:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c6ce960b/2, rc 0, transno 812 00000100:00100000:1.0:1781281098.123564:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6ce960b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.123609:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781281098.123619:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.123645:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281098.123750:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791296 00000100:00100000:0.0:1781281098.123776:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791680 00000100:00100000:0.0:1781281098.123787:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791360 00000100:00100000:0.0:1781281098.123797:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791616 00000100:00100000:0.0:1781281098.123812:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022 00000100:00100000:0.0:1781281098.123818:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce66c8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3175:x1867808083791296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281098.123842:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:266 count 1 00010000:00010000:0.0:1781281098.123862:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.123876:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 25 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.123884:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.123885:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.123887:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 4/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.123908:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 25 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.123922:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 25 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.123931:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7677f1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083791808:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.123974:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5b990ca going to sleep for 6 seconds 00010000:00010000:0.0:1781281098.123986:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.123989:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.123996:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005c770f98 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.124000:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.124007:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.124021:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 1/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.124027:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c770f98/0xce40b48e7cd22699 lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.124045:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.124047:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.124048:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.124128:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.124194:0:14248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:3.0:1781281098.124200:0:14248:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3175:x1867808083791680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.124212:0:14248:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:262 count 1 00010000:00010000:3.0:1781281098.124225:0:14248:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124239:0:14248:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 25 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124245:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124246:0:14248:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124247:0:14248:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 4/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124266:0:14248:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 25 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124273:0:14248:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 25 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.124282:0:14248:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083791872:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.124307:0:14248:0:(client.c:2500:ptlrpc_set_wait()) set 000000008f56e815 going to sleep for 6 seconds 00000100:00100000:3.0:1781281098.124324:0:14274:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:3.0:1781281098.124328:0:14274:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+57:3175:x1867808083791360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.124341:0:14274:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:276 count 1 00010000:00010000:3.0:1781281098.124351:0:14274:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124362:0:14274:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 25 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124367:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124369:0:14274:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124370:0:14274:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 4/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124385:0:14274:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 25 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124392:0:14274:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 25 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.124401:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f80346c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083791936:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.124422:0:14274:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eed00176 going to sleep for 6 seconds 00000100:00100000:3.0:1781281098.124492:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:3.0:1781281098.124495:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3178:x1867808083791616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.124508:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:251 count 1 00010000:00010000:3.0:1781281098.124521:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124531:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 20 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124537:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124538:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.124572:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 4/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124593:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 20 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.124607:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 20 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.124617:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004ac67cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083792000:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.124649:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 0000000046b91887 going to sleep for 6 seconds 00000100:00100000:3.0:1781281098.125711:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.125732:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.125750:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.125789:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.125818:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811584 00010000:00010000:3.0:1781281098.125847:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 5/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 21 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.125874:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811712 00010000:00010000:3.0:1781281098.125884:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 5/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 22 pid: 14239 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.125896:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811520 00010000:00010000:3.0:1781281098.125905:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 23 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.125916:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811648 00010000:00010000:3.0:1781281098.125923:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 24 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.125935:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4886 00000100:00100000:3.0:1781281098.125940:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6398534 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+24:2269:x1867808064811584:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.125952:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.125956:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 5/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 24 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.125964:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 24 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.125984:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.125986:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.125989:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.125996:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 4/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126013:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.126047:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6398534 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+24:2269:x1867808064811584:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 106us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.126172:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4886 00000100:00100000:3.0:1781281098.126191:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4887 00000100:00100000:3.0:1781281098.126195:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c51624ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+23:2269:x1867808064811712:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.126203:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.126207:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 5/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 23 pid: 14239 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126214:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 4/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 23 pid: 14239 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126232:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126233:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126235:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126240:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 4/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126252:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.126269:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c51624ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+23:2269:x1867808064811712:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 73us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.126274:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4887 00000100:00100000:3.0:1781281098.126285:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4888 00000100:00100000:3.0:1781281098.126289:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078020e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2269:x1867808064811520:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.126295:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.126299:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 22 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126307:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 22 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126320:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126321:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126323:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126329:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 4/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126341:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.126357:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078020e9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2269:x1867808064811520:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 67us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.126363:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4888 00000100:00100000:3.0:1781281098.126374:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4889 00000100:00100000:3.0:1781281098.126377:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000abc75a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+21:2269:x1867808064811648:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.126384:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.126387:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 21 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126395:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 21 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.126407:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126408:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.126410:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126416:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 4/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126426:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.126441:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000abc75a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+21:2269:x1867808064811648:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 63us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.126446:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4889 00010000:00010000:3.0:1781281098.126529:0:14239:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003366f323/0xce40b48e7cd01372 lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd03 expref: 20 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.126565:0:14239:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14239:1867808083790848:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.126582:0:14239:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126590:0:14239:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126596:0:14239:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126604:0:14239:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126610:0:14239:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.126629:0:14239:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.127251:0:14239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3175:x1867808083790464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17368us (17614us total) trans 4294968354 rc 0/0 00000100:00100000:3.0:1781281098.127261:0:14239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00010000:00010000:1.0:1781281098.127405:0:14244:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b8815b/0xce40b48e7cd025a8 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0049d expref: 19 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.127418:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14244:1867808083790720:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.127435:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.127443:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.127448:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.127455:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.127461:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.127490:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.127650:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3178:x1867808083790656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18201us (18243us total) trans 4294968355 rc 0/0 00000100:00100000:1.0:1781281098.127656:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1781281098.127846:0:7754:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083791744 00010000:00010000:2.0:1781281098.127891:0:14276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e3f7809/0xce40b48e7cd18b34 lrc: 0/0,0 mode: --/PW res: [0x199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c078d3 expref: 18 pid: 14239 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.127903:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da78fd71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083791104:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.127916:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.127923:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.127934:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.127940:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,1 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.127945:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 2/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.127954:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1781281098.128180:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070e730d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+62:3177:x1867808083791040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11443us (11508us total) trans 4294968356 rc 0/0 00000100:00100000:2.0:1781281098.128187:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000004:00080000:2.0:1781281098.128220:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000945477a4/2, rc 0, transno 1060 00000100:00100000:2.0:1781281098.128231:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000945477a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.128295:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da78fd71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.128331:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.128360:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792064 00000100:00100000:2.0:1781281098.128383:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1781281098.128388:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cf7a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+62:3177:x1867808083792064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.128409:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:277 count 1 00010000:00010000:2.0:1781281098.128430:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128444:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 17 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128452:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.128454:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.128456:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 4/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128487:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 17 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128498:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 17 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.128508:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14267:1867808083792128:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.128580:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 0000000085896c47 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.128617:0:7754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:2.0:1781281098.128621:0:7754:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a800886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3175:x1867808083791744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.128632:0:7754:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:234 count 1 00010000:00010000:2.0:1781281098.128645:0:7754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128656:0:7754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128662:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.128664:0:7754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.128665:0:7754:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 4/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128689:0:7754:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.128697:0:7754:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 25 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.128706:0:7754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f305529c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083792192:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.128727:0:7754:0:(client.c:2500:ptlrpc_set_wait()) set 0000000022ac83d5 going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.141681:0:14278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b019de74/0xce40b48e7cd01c4e lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c000ad expref: 17 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.141707:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14278:1867808083790912:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.141730:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.141740:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.141747:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.141757:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.141776:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.141789:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1781281098.142285:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+63:3175:x1867808083790784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32392us (32592us total) trans 4294968357 rc 0/0 00000100:00100000:1.0:1781281098.142296:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000004:00080000:1.0:1781281098.142339:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000871c5db5/2, rc 0, transno 1061 00000100:00100000:1.0:1781281098.142354:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871c5db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790784:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.142368:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c7e3c20a/2, rc 0, transno 1058 00000100:00100000:1.0:1781281098.142372:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7e3c20a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790464:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1781281098.142391:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1781281098.142396:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142405:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ba94e0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.142408:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142416:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142438:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 1/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142444:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035ba94e0/0xce40b48e7cd226ae lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142461:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1781281098.142464:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142482:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da730b65 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.142485:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142492:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142502:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 1/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142508:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd226a7 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142521:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281098.142524:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 2/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142530:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e7b3a0 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.142532:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 2/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142538:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 3/0,0 mode: PW/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142569:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 1/0,0 mode: --/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142575:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7b3a0/0xce40b48e7cd226bc lrc: 0/0,0 mode: --/PW res: [0x199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142588:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.142590:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142602:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba10c2d7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.142604:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142610:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142619:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 1/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142625:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba10c2d7/0xce40b48e7cd226b5 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.142640:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.142641:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.142642:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1781281098.142658:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a36bb8b8/2, rc 0, transno 1059 00000100:00100000:1.0:1781281098.142663:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a36bb8b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790656:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.142673:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000ca6451f8/2, rc 0, transno 1057 00000100:00100000:1.0:1781281098.142676:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca6451f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790528:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.142687:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000011fa024f/2, rc 0, transno 809 00000100:00100000:1.0:1781281098.142699:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011fa024f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790016:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1781281098.142708:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009d6b34d8/2, rc 0, transno 811 00000100:00100000:1.0:1781281098.142711:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d6b34d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083790080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.142867:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.142904:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.142939:0:14278:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792320 00000100:00100000:1.0:1781281098.142968:0:14278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1781281098.142974:0:14278:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001cd763e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+59:3175:x1867808083792320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.142998:0:14278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:259 count 1 00010000:00010000:1.0:1781281098.143021:0:14278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.143037:0:14278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 25 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.143046:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.143048:0:14278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.143050:0:14278:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 4/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.143750:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a90157d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.143800:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.143824:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1781281098.143830:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab1fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.143851:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.143865:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074cc6eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.143883:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.144037:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c847f2ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.144084:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.144112:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792448 00000100:00100000:2.0:1781281098.144140:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792256 00000100:00100000:2.0:1781281098.144154:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792512 00000100:00100000:2.0:1781281098.144163:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792576 00000100:00100000:2.0:1781281098.144171:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:2.0:1781281098.144175:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3177:x1867808083792448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.144193:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:418 count 1 00010000:00010000:2.0:1781281098.144210:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144226:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 16 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144233:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144235:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144236:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 4/0,1 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144262:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 3/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 16 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144273:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 4/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 16 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.144284:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006151247b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083792640:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.144335:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ca4cf6bb going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.144350:0:14240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:2.0:1781281098.144355:0:14240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3177:x1867808083792256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.144367:0:14240:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:431 count 1 00010000:00010000:2.0:1781281098.144378:0:14240:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144390:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 25 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144396:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144398:0:14240:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144399:0:14240:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 4/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144416:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 25 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144425:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 25 pid: 14278 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.144434:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23188b9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14240:1867808083792704:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.144457:0:14240:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b37535c7 going to sleep for 6 seconds 00000100:00100000:2.0:1781281098.144492:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:2.0:1781281098.144497:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3177:x1867808083792512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.144509:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:256 count 1 00010000:00010000:2.0:1781281098.144520:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144530:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 16 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144535:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144536:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144538:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 4/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144583:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 16 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144595:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 16 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.144602:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e997fce pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7752:1867808083792768:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.144623:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000162f93 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.144638:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1781281098.144643:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef69984 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.144665:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.144684:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083792384 00000100:00100000:2.0:1781281098.144701:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:2.0:1781281098.144705:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a135e866 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+66:3175:x1867808083792576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.144716:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:233 count 1 00010000:00010000:2.0:1781281098.144726:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144736:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 16 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144742:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144743:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144744:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 4/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144759:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 16 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144771:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 16 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.144780:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f04d9420 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083792832:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.144801:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 000000005ecc7198 going to sleep for 43 seconds 00000100:00100000:2.0:1781281098.144817:0:14262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033 00000100:00100000:2.0:1781281098.144821:0:14262:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eabab400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3175:x1867808083792384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.144834:0:14262:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:422 count 1 00010000:00010000:2.0:1781281098.144844:0:14262:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144855:0:14262:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144861:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144863:0:14262:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.144864:0:14262:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 4/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144881:0:14262:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.144888:0:14262:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.144896:0:14262:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083792896:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.144918:0:14262:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bdb9595f going to sleep for 43 seconds 00010000:00010000:1.0:1781281098.145090:0:14278:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 25 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.145097:0:14278:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.145105:0:14278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14278:1867808083792960:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.145128:0:14278:0:(client.c:2500:ptlrpc_set_wait()) set 00000000438be9e4 going to sleep for 6 seconds 00010000:00010000:1.0:1781281098.145158:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1781281098.145191:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d648dc00/2, rc 0, transno 810 00000100:00100000:1.0:1781281098.145214:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d648dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083789888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.148283:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1781281098.148305:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000502f1435 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.148375:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.148500:0:14244:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793024 00000100:00100000:1.0:1781281098.148567:0:14244:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:1.0:1781281098.148573:0:14244:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b479ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3175:x1867808083793024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.148599:0:14244:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:232 count 1 00010000:00010000:1.0:1781281098.148625:0:14244:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.148646:0:14244:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.148654:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.148656:0:14244:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.148658:0:14244:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 4/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.148684:0:14244:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.148695:0:14244:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.148705:0:14244:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14244:1867808083793088:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.148750:0:14244:0:(client.c:2500:ptlrpc_set_wait()) set 000000002e9b6348 going to sleep for 6 seconds 00010000:00010000:3.0:1781281098.148943:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.152437:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152459:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152492:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152591:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152607:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152623:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152649:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.152680:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811776 00010000:00010000:3.0:1781281098.152721:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 5/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 17 pid: 14274 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.152751:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811840 00000100:00100000:2.0:1781281098.152891:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016b93773 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083791488:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.152918:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.152948:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc0c1439 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083791552:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.152961:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.152980:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811904 00010000:00010000:2.0:1781281098.152992:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 18 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.153007:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064811968 00010000:00010000:2.0:1781281098.153017:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 27 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.153028:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812096 00010000:00010000:2.0:1781281098.153036:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 28 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.153046:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812032 00010000:00010000:2.0:1781281098.153053:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 5/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 29 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.153070:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812160 00010000:00010000:2.0:1781281098.153077:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 19 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.153091:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4890 00000100:00100000:2.0:1781281098.153097:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008600bb97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+19:2271:x1867808064811776:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281098.153111:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153116:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 5/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 19 pid: 14274 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153126:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 4/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 19 pid: 14274 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153151:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153154:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153171:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153181:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 4/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153199:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153246:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008600bb97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+19:2271:x1867808064811776:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 148us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153254:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4890 00000100:00100000:2.0:1781281098.153272:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4891 00000100:00100000:2.0:1781281098.153277:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+18:2270:x1867808064811904:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1781281098.153284:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153287:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 18 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153295:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 18 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153308:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d60f3d2/0xce40b48e7cd010cb lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffc15 expref: 18 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153320:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153321:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153323:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153329:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 4/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153345:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153361:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:2270:x1867808064811904:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 84us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153367:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4891 00000100:00100000:2.0:1781281098.153381:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4892 00000100:00100000:2.0:1781281098.153385:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2271:x1867808064811968:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.153393:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153396:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 29 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153404:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 29 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153418:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153419:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153421:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153427:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 4/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153439:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153454:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+29:2271:x1867808064811968:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 68us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153460:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4892 00000100:00100000:2.0:1781281098.153485:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4893 00000100:00100000:2.0:1781281098.153489:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6398534 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+28:2271:x1867808064812096:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.153495:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153498:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 28 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153505:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 28 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153518:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153520:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153522:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153528:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 4/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153567:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153585:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6398534 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+28:2271:x1867808064812096:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 95us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153591:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4893 00000100:00100000:2.0:1781281098.153605:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4894 00000100:00100000:2.0:1781281098.153609:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c51624ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+27:2271:x1867808064812032:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.153616:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153619:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 5/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 27 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153627:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 27 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153639:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153640:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153641:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153648:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 4/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153659:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153675:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c51624ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+27:2271:x1867808064812032:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 66us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153681:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4894 00000100:00100000:2.0:1781281098.153692:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4895 00000100:00100000:2.0:1781281098.153696:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dd9e8eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+16:2271:x1867808064812160:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1781281098.153702:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.153706:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 16 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153713:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 16 pid: 14277 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.153724:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153726:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.153728:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153733:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 4/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153743:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.153769:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dd9e8eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+16:2271:x1867808064812160:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 61us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.153775:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4895 00010000:00010000:2.0:1781281098.153795:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153802:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153810:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153817:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.153833:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.154309:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c608f37c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3177:x1867808083791168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33324us (33512us total) trans 4294968358 rc 0/0 00000100:00100000:2.0:1781281098.154317:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000004:00080000:2.0:1781281098.154358:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000001eaef2af/2, rc 0, transno 1062 00000100:00100000:2.0:1781281098.154366:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eaef2af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.154423:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3002a04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083793152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1781281098.154449:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.154487:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793152 00000100:00100000:2.0:1781281098.154512:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:2.0:1781281098.154515:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4993208 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3177:x1867808083793152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1781281098.154536:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:280 count 1 00010000:00010000:2.0:1781281098.154579:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.154593:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 15 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.154600:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.154602:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.154603:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 4/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.154622:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 15 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.154631:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 15 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.154641:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083793216:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.154669:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e4bd0054 going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.155261:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 26 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.155295:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4896 00000100:00100000:3.0:1781281098.155300:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002819e6c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+26:2271:x1867808064811840:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.155309:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.155313:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 26 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.155323:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 26 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.155340:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c601558e/0xce40b48e7ccffe09 lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff49e expref: 26 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.155352:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.155353:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.155355:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155362:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 4/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155385:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.155411:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002819e6c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+25:2271:x1867808064811840:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 111us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.155418:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4896 00010000:00010000:3.0:1781281098.155488:0:14248:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c043805a/0xce40b48e7cd01a25 lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfffbf expref: 24 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.155498:0:14248:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14248:1867808083791872:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.155513:0:14248:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155521:0:14248:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155527:0:14248:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155533:0:14248:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155539:0:14248:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155572:0:14248:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281098.155830:0:14248:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3175:x1867808083791680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31629us (33827us total) trans 4294968109 rc 0/0 00000100:00100000:3.0:1781281098.155840:0:14248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00010000:00010000:3.0:1781281098.155871:0:14274:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f743e670/0xce40b48e7cd024e4 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00457 expref: 23 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.155881:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f80346c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14274:1867808083791936:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.155896:0:14274:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155902:0:14274:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155908:0:14274:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155914:0:14274:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155919:0:14274:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.155931:0:14274:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1781281098.156039:0:14274:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+62:3175:x1867808083791360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31709us (33995us total) trans 4294968110 rc 0/0 00000100:00100000:3.0:1781281098.156045:0:14274:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00010000:00010000:3.0:1781281098.156072:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0b6bf7f/0xce40b48e7cd01023 lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffbcf expref: 15 pid: 14277 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.156087:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004ac67cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14266:1867808083792000:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.156097:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.156103:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.156108:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.156113:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.156118:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.156125:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1781281098.156417:0:14277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089396477/0xce40b48e7cd19cd0 lrc: 0/0,0 mode: --/PW res: [0x19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c07e83 expref: 14 pid: 14274 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.156428:0:14277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14277:1867808083791232:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.156439:0:14277:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156450:0:14277:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156455:0:14277:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156461:0:14277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,1 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156466:0:14277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 2/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156486:0:14277:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1781281098.156639:0:14277:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000042b1fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+68:3175:x1867808083790976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36292us (36347us total) trans 4294968359 rc 0/0 00000100:00100000:1.0:1781281098.156646:0:14277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00010000:00010000:1.0:1781281098.156749:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1781281098.156754:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156774:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000074ed0297 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.156777:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156784:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156803:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 1/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156809:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ed0297/0xce40b48e7cd226d1 lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156821:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1781281098.156823:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156829:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058e1695c already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.156830:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156836:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156844:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 1/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156848:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e1695c/0xce40b48e7cd226df lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156858:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1781281098.156860:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156870:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a70bad8b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.156872:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156877:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156883:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 1/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156888:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a70bad8b/0xce40b48e7cd226e6 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156912:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1781281098.156914:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156919:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006dd3f65e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.156921:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156926:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156934:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 1/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156944:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dd3f65e/0xce40b48e7cd226ed lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156953:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.156954:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 2/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156959:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d80d7073 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.156960:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 2/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156965:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 3/0,0 mode: PW/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156972:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 1/0,0 mode: --/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156977:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80d7073/0xce40b48e7cd226c3 lrc: 0/0,0 mode: --/PW res: [0x19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.156986:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.156987:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.156988:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.157369:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3178:x1867808083791616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32871us (35158us total) trans 4294968360 rc 0/0 00000100:00100000:3.0:1781281098.157376:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00010000:00010000:3.0:1781281098.157400:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.157852:0:7755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0b1cdd0/0xce40b48e7cd01d27 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00108 expref: 22 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.157866:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7677f1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083791808:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.157882:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.157890:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.157895:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.157902:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.157907:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.157921:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.158308:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce66c8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3175:x1867808083791296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34489us (36349us total) trans 4294968111 rc 0/0 00000100:00100000:0.0:1781281098.158317:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022 00010000:00010000:0.0:1781281098.159641:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.159658:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.159686:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.159692:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.159713:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1781281098.159965:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afcd180c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+62:3177:x1867808083791424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39098us (39200us total) trans 4294968112 rc 0/0 00000100:00100000:0.0:1781281098.159975:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00010000:00010000:0.0:1781281098.160183:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.160189:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160199:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.160203:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160212:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160234:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 1/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160240:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd226d8 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160265:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.160267:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160274:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ed31c0f9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.160276:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160282:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160291:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 1/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160297:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed31c0f9/0xce40b48e7cd226ca lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.160308:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.160310:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.160311:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.160585:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1781281098.160625:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000058cda886/2, rc 0, transno 814 00000100:00100000:3.0:1781281098.160640:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000058cda886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791360:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.160653:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d5dc0226/2, rc 0, transno 815 00000100:00100000:3.0:1781281098.160656:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d5dc0226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791296:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.160664:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000063deab88/2, rc 0, transno 813 00000100:00100000:3.0:1781281098.160667:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063deab88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791680:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.160677:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000006406b574/2, rc 0, transno 1063 00000100:00100000:3.0:1781281098.160685:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006406b574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083790976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.160790:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f80346c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.160831:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.160852:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781281098.160857:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.160877:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.160905:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793344 00000100:00100000:3.0:1781281098.160940:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793408 00000100:00100000:3.0:1781281098.160957:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:3.0:1781281098.160962:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3175:x1867808083793344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.160988:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:231 count 1 00010000:00010000:3.0:1781281098.161010:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161029:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 21 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161037:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.161039:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.161041:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 4/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161069:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 21 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161080:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 21 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.161091:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6398534 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083793536:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.161136:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dbe7142c going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.161152:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:3.0:1781281098.161156:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3175:x1867808083793408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.161169:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:255 count 1 00010000:00010000:3.0:1781281098.161180:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161191:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 21 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161197:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.161198:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.161200:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 4/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161216:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 21 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.161222:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 21 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.161230:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c51624ad pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083793600:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.161251:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1caee80 going to sleep for 43 seconds 00000100:00100000:0.0:1781281098.161367:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.161465:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.161745:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812224 00010000:00010000:1.0:1781281098.162026:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.162041:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004ac67cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.162077:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.162104:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793280 00000100:00100000:1.0:1781281098.162135:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1781281098.162139:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+68:3178:x1867808083793280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281098.162154:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:222 count 1 00010000:00010000:1.0:1781281098.162189:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.162203:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 2/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 14 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.162210:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.162211:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.162213:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 4/0,1 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.162235:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 3/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 14 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.162244:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 4/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 14 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.162253:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068983bef pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083793664:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.162284:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 43 seconds 00000004:00080000:1.0:1781281098.162313:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000007d984b3b/2, rc 0, transno 1064 00000100:00100000:1.0:1781281098.162321:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d984b3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083791616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.162330:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1781281098.162336:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.162359:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1781281098.162485:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 14 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.162512:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812288 00010000:00010000:3.0:1781281098.162524:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 22 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.162597:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4897 00000100:00100000:3.0:1781281098.162602:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+14:2271:x1867808064812224:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.162613:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.162617:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 14 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.162627:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 14 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.162650:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.162652:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.162656:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.162664:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 4/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.162680:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.162705:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+14:2271:x1867808064812224:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 102us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.162714:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4897 00000100:00100000:3.0:1781281098.162731:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4898 00000100:00100000:3.0:1781281098.162736:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2271:x1867808064812288:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.162743:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.162747:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 22 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.162908:0:14267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6996118/0xce40b48e7cd0273e lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00529 expref: 13 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.162922:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e92ffca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14267:1867808083792128:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.162939:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.162949:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.162955:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.162963:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.162975:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.162995:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1781281098.163263:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cf7a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+69:3177:x1867808083792064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34874us (34931us total) trans 4294968361 rc 0/0 00000100:00100000:2.0:1781281098.163272:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1781281098.163291:0:14267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793472 00000100:00100000:2.0:1781281098.163314:0:14267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:2.0:1781281098.163319:0:14267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+64:3178:x1867808083793472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281098.163335:0:14267:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:230 count 1 00010000:00010000:2.0:1781281098.163350:0:14267:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.163361:0:14267:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.163367:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.163369:0:14267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281098.163370:0:14267:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 4/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.163394:0:14267:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.163403:0:14267:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 22 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.163422:0:14267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000026ffe626 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083793728:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281098.163452:0:14267:0:(client.c:2500:ptlrpc_set_wait()) set 0000000046b0eb6f going to sleep for 43 seconds 00000004:00080000:2.0:1781281098.163498:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000da78fd71/2, rc 0, transno 1065 00000100:00100000:2.0:1781281098.163504:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da78fd71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792064:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1781281098.163515:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a2d5e1ef/2, rc 0, transno 816 00000100:00100000:2.0:1781281098.163526:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2d5e1ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083791424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281098.163625:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23188b9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14240:1867808083792704:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.163639:0:14240:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.163716:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e997fce pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7752:1867808083792768:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.163727:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.163779:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.163867:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281098.164401:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.164407:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.164418:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000eac9999e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.164421:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.164430:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.164448:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 1/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.164454:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eac9999e/0xce40b48e7cd226f4 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.164486:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.164487:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.164489:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.164892:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 22 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.164916:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.164918:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.164921:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.164930:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 4/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.164948:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.165005:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2271:x1867808064812288:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 2267us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.165014:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4898 00000100:00100000:3.0:1781281098.165047:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812352 00010000:00010000:3.0:1781281098.165066:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 22 pid: 14278 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.165079:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812416 00010000:00010000:3.0:1781281098.165089:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 13 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.165101:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4899 00000100:00100000:3.0:1781281098.165105:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e997fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2271:x1867808064812352:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.165116:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.165120:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 22 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165127:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 22 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165139:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e14cae/0xce40b48e7cd1ce16 lrc: 0/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08f2a expref: 22 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165148:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.165150:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.165151:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165168:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 4/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165189:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.165206:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e997fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+21:2271:x1867808064812352:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 100us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.165212:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4899 00000100:00100000:3.0:1781281098.165224:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4900 00000100:00100000:3.0:1781281098.165228:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a23188b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2271:x1867808064812416:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.165235:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.165238:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 13 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165245:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 13 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165258:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cc6ce6/0xce40b48e7cd01571 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffdce expref: 13 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.165266:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.165268:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.165269:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165275:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 4/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165293:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.165308:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a23188b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064812416:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 80us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.165314:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4900 00010000:00010000:3.0:1781281098.165375:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165384:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165397:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165404:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165419:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.165953:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb9479b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3177:x1867808083792512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21454us (22069us total) trans 4294968362 rc 0/0 00000100:00100000:3.0:1781281098.165962:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00010000:00010000:3.0:1781281098.165985:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.165989:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.165997:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008d3152b9 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.166000:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166007:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166020:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 1/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166026:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d3152b9/0xce40b48e7cd22717 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166045:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.166046:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.166047:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.166134:0:7754:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f30f88a8/0xce40b48e7ccffefe lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff507 expref: 20 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.166146:0:7754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f305529c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7754:1867808083792192:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.166166:0:7754:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166173:0:7754:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166179:0:7754:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166184:0:7754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166190:0:7754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166204:0:7754:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.166368:0:7754:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a800886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3175:x1867808083791744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37745us (42722us total) trans 4294968113 rc 0/0 00000100:00100000:3.0:1781281098.166374:0:7754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000004:00080000:3.0:1781281098.166416:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002252d9c7/2, rc 0, transno 817 00000100:00100000:3.0:1781281098.166424:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083791744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.166461:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078020e9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.166505:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.166536:0:7754:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793856 00000100:00100000:3.0:1781281098.166584:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:3.0:1781281098.166588:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad065030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3175:x1867808083793856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.166608:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:229 count 1 00010000:00010000:3.0:1781281098.166625:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166638:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166644:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.166646:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.166648:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 4/0,1 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166669:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 3/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166679:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 4/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 19 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.166689:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f102fb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083793920:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.166729:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 000000005f8b0e2f going to sleep for 43 seconds 00010000:00010000:3.0:1781281098.166747:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.166750:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166757:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003965d60b already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.166760:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166766:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166778:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 1/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166783:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003965d60b/0xce40b48e7cd226fb lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166795:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.166797:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.166798:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.166809:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.166833:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.166859:0:14226:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083793792 00000004:00080000:0.0:1781281098.166873:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000074cc6eeb/2, rc 0, transno 1066 00000100:00100000:3.0:1781281098.166877:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:3.0:1781281098.166880:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9db967c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3178:x1867808083793792:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281098.166888:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074cc6eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792512:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1781281098.166902:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:256 count 1 00010000:00010000:3.0:1781281098.166913:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166929:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 19 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166935:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.166936:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.166937:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 4/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166954:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 19 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.166961:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 19 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.166969:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e444468c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083793984:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.167006:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00010000:00010000:1.0:1781281098.167780:0:14240:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.167792:0:14240:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.167799:0:14240:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.167804:0:14240:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.167821:0:14240:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.168064:0:14240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8228c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3177:x1867808083792256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23707us (24211us total) trans 4294968114 rc 0/0 00000100:00100000:1.0:1781281098.168073:0:14240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000004:00080000:1.0:1781281098.168114:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000dab1fc84/2, rc 0, transno 818 00000100:00100000:0.0:1781281098.168118:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.168123:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab1fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1781281098.168134:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.168151:0:14244:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000398b4a41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14244:1867808083793088:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.168166:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281098.168179:0:14244:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.168185:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.168200:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.168204:0:14278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052409705 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14278:1867808083792960:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.168214:0:14278:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.168225:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281098.168227:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.168230:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.168237:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e7699bb8 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.168240:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.168247:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.168268:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 1/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.168274:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7699bb8/0xce40b48e7cd22710 lrc: 0/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.168283:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281098.168295:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.168300:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068983bef pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083793664:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.168306:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1781281098.168311:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.168322:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.168323:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.168325:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281098.168334:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.168661:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006151247b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083792640:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.168676:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.168700:0:14267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000026ffe626 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14267:1867808083793728:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.168709:0:14267:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.168729:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14261:1867808083793216:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.168738:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281098.168788:0:14262:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14262:1867808083792896:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.168800:0:14262:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781281098.171857:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.171995:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f102fb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083793920:192.168.202.40@tcp:104: 00010000:00010000:2.0:1781281098.172025:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.172137:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812544 00010000:00010000:3.0:1781281098.172224:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 12 pid: 14240 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172247:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812672 00010000:00010000:3.0:1781281098.172259:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 20 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172269:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812480 00010000:00010000:3.0:1781281098.172276:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 5/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 13 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172293:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812608 00010000:00010000:3.0:1781281098.172300:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 21 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172310:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812736 00010000:00010000:3.0:1781281098.172317:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 14 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172326:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812800 00010000:00010000:3.0:1781281098.172334:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 4/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 15 pid: 14276 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172343:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812864 00010000:00010000:3.0:1781281098.172353:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 22 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172363:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812928 00010000:00010000:3.0:1781281098.172371:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 5/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 23 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172381:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813056 00010000:00010000:3.0:1781281098.172388:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 4/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 16 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172397:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064812992 00010000:00010000:3.0:1781281098.172404:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 24 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172417:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813120 00010000:00010000:3.0:1781281098.172424:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 5/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 25 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.172438:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4901 00000100:00100000:3.0:1781281098.172444:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+16:2270:x1867808064812544:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.172458:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.172462:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172484:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172509:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c0a8f2b/0xce40b48e7cd1b232 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c08591 expref: 16 pid: 14240 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172524:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.172526:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.172530:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.172538:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 4/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.172597:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1781281098.172611:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f04d9420 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14276:1867808083792832:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281098.172625:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.172639:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+15:2270:x1867808064812544:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 195us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.172647:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4901 00000100:00100000:3.0:1781281098.172666:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4902 00000100:00100000:3.0:1781281098.172669:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+25:2270:x1867808064812672:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.172677:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.172681:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172689:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172703:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066cfdd68/0xce40b48e7ccffc81 lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff412 expref: 25 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.172712:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.172713:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.172715:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.172721:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 4/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.172745:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281098.172883:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e444468c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083793984:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.172895:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.173041:0:14244:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.173049:0:14244:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.173058:0:14244:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.173064:0:14244:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.173089:0:14244:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1781281098.173237:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.173242:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173249:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005be09fc2 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.173252:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173260:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173272:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 1/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173278:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be09fc2/0xce40b48e7cd2272c lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173292:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.173293:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.173295:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.173349:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+24:2270:x1867808064812672:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 677us (5213us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.173357:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4902 00000100:00100000:3.0:1781281098.173373:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4903 00000100:00100000:3.0:1781281098.173378:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006762f465 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+14:2270:x1867808064812480:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.173387:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.173391:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 14 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.173400:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 14 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.173413:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d01922bd/0xce40b48e7ccffebf lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff4e4 expref: 14 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.173423:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.173424:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.173426:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.173432:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 4/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.173495:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1781281098.173885:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173893:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173900:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173906:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.173920:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1781281098.178317:0:14244:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b479ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3175:x1867808083793024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29735us (29935us total) trans 4294968115 rc 0/0 00000100:00100000:0.0:1781281098.178336:0:14244:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00010000:00010000:0.0:1781281098.180895:0:14262:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.180916:0:14262:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.180927:0:14262:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.180931:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006762f465 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2270:x1867808064812480:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 7549us (12761us total) trans 0 rc 0/0 00010000:00010000:0.0:1781281098.180933:0:14262:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.180943:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4903 00010000:00010000:0.0:1781281098.180954:0:14262:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1781281098.181012:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4904 00000100:00100000:3.0:1781281098.181018:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+23:2270:x1867808064812608:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.181035:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181043:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 23 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181059:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 23 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181083:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cc0b4ac/0xce40b48e7cd0180a lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffed1 expref: 23 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181097:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181098:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181102:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181110:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 4/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181137:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181173:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+22:2270:x1867808064812608:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 155us (12988us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181179:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4904 00000100:00100000:3.0:1781281098.181190:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4905 00000100:00100000:3.0:1781281098.181194:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2270:x1867808064812736:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1781281098.181201:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181205:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 12 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181213:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 12 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181229:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6026c36/0xce40b48e7cd02a78 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0066b expref: 12 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.181233:0:14262:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eabab400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+70:3175:x1867808083792384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36411us (36568us total) trans 4294968364 rc 0/0 00010000:00010000:3.0:1781281098.181238:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181239:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1781281098.181240:0:14262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033 00010000:00010000:3.0:1781281098.181241:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181247:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 4/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181263:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181279:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+11:2270:x1867808064812736:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 84us (13079us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181286:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4905 00000100:00100000:3.0:1781281098.181298:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4906 00000100:00100000:3.0:1781281098.181303:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+10:2271:x1867808064812800:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.181309:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181313:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 4/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 10 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181322:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 3/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 10 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181335:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4aea/0xce40b48e7cd1a79d lrc: 0/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c081fc expref: 10 pid: 14276 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181348:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181349:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181351:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181356:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 4/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181384:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181406:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+9:2271:x1867808064812800:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 102us (13180us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181414:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4906 00000100:00100000:3.0:1781281098.181425:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4907 00000100:00100000:3.0:1781281098.181429:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+21:2271:x1867808064812864:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.181436:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181440:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 21 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181448:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 21 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181459:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181460:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181462:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181467:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 4/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181489:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181505:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+21:2271:x1867808064812864:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 74us (13221us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181511:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4907 00000100:00100000:3.0:1781281098.181524:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4908 00000100:00100000:3.0:1781281098.181527:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+20:2271:x1867808064812928:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1781281098.181532:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181535:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181538:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 5/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 20 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281098.181540:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.181563:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181564:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 20 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:0.0:1781281098.181569:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181576:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181577:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181579:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181585:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 4/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.181587:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1781281098.181596:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181612:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+20:2271:x1867808064812928:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 83us (13317us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181618:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4908 00000100:00100000:3.0:1781281098.181631:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4909 00000100:00100000:3.0:1781281098.181635:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+8:2271:x1867808064813056:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.181642:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181646:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 4/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181653:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 3/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181665:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcbdac67/0xce40b48e7ccfeb9b lrc: 0/0,0 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee23 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181674:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181675:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.181676:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181682:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 4/0,1 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.181698:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.181709:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+7:2271:x1867808064813056:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 73us (13403us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.181715:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4909 00000100:00100000:0.0:1781281098.181725:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009091cd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3177:x1867808083792448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37549us (37926us total) trans 4294968365 rc 0/0 00000100:00100000:3.0:1781281098.181727:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4910 00000100:00100000:3.0:1781281098.181731:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d77ef111 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+19:2271:x1867808064812992:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1781281098.181731:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00010000:00010000:3.0:1781281098.181738:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.181742:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 19 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.181750:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 19 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.182224:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb41e673/0xce40b48e7ccffb07 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff378 expref: 19 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.182235:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.182236:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.182238:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182244:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 4/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182270:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.182287:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d77ef111 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+18:2271:x1867808064812992:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 555us (13953us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.182294:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4910 00000100:00100000:3.0:1781281098.182323:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4911 00000100:00100000:3.0:1781281098.182327:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:2270:x1867808064813120:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1781281098.182335:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.182339:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 17 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.182347:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 17 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.182365:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027366e54/0xce40b48e7cd01460 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd73 expref: 17 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.182374:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.182376:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.182377:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182383:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 4/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182402:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.182416:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+16:2270:x1867808064813120:12345-192.168.202.40@tcp:103:ldlm_bl_01.0 Request processed in 88us (10568us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.182422:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4911 00010000:00010000:3.0:1781281098.182486:0:14266:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da9511e/0xce40b48e7cd01380 lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bffd18 expref: 15 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.182497:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c51624ad pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083793600:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.182515:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182522:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182527:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182533:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182538:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.182574:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1781281098.182773:0:14267:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.182781:0:14267:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.182787:0:14267:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.182792:0:14267:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.182800:0:14267:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1781281098.182969:0:14267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f27253a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:3178:x1867808083793472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19648us (20608us total) trans 4294968116 rc 0/0 00000100:00100000:0.0:1781281098.182976:0:14267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:3.0:1781281098.183293:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092018bde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+67:3175:x1867808083793408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22135us (22415us total) trans 4294968117 rc 0/0 00000100:00100000:3.0:1781281098.183300:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00010000:00010000:3.0:1781281098.183320:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183329:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183336:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,1 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183342:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 2/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183351:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1781281098.183589:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009db642b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+70:3178:x1867808083793280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21448us (21512us total) trans 4294968366 rc 0/0 00000100:00100000:3.0:1781281098.183595:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00010000:00010000:3.0:1781281098.183618:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183625:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183632:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183638:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.183646:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1781281098.183941:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4993208 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3177:x1867808083793152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29423us (29490us total) trans 4294968367 rc 0/0 00000100:00100000:3.0:1781281098.183947:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00010000:00010000:3.0:1781281098.183986:0:7755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009dca881/0xce40b48e7ccffbee lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff3c5 expref: 14 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.183998:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6398534 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083793536:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.184017:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184025:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184030:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184041:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184046:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184054:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1781281098.184237:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff06a644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3175:x1867808083793344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23274us (23407us total) trans 4294968118 rc 0/0 00000100:00100000:3.0:1781281098.184243:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00010000:00010000:3.0:1781281098.184264:0:14278:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184272:0:14278:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184278:0:14278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184284:0:14278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.184292:0:14278:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:3.0:1781281098.184608:0:14278:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001cd763e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+67:3175:x1867808083792320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41632us (41703us total) trans 4294968119 rc 0/0 00000100:00100000:3.0:1781281098.184614:0:14278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000004:00080000:3.0:1781281098.184658:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004818406c/2, rc 0, transno 821 00000100:00100000:3.0:1781281098.184664:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004818406c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793408:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.184672:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000f80346c6/2, rc 0, transno 822 00000100:00100000:3.0:1781281098.184675:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f80346c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793344:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.184686:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000502f1435/2, rc 0, transno 819 00000100:00100000:3.0:1781281098.184689:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000502f1435 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793024:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.184700:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002ef69984/2, rc 0, transno 1068 00000100:00100000:3.0:1781281098.184717:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef69984 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792384:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1781281098.184728:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000063ad18a3/2, rc 0, transno 823 00000100:00100000:3.0:1781281098.184731:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063ad18a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.184966:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d43769d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.185005:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.185027:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1781281098.185032:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6398534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.185052:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.185064:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b36b7248 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794304:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281098.185082:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.185120:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794240 00000100:00100000:0.0:1781281098.185136:0:14261:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794048 00000100:00100000:3.0:1781281098.185144:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794304 00000100:00100000:0.0:1781281098.185169:0:14261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1781281098.185173:0:14261:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000306d8604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083794240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1781281098.185200:0:14261:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:226 count 1 00000100:00100000:1.0:1781281098.185215:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c51624ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794112:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.185225:0:14261:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.185242:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1781281098.185245:0:14261:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.185253:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.185254:0:14261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1781281098.185256:0:14261:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 4/0,1 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.185285:0:14261:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 3/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.185295:0:14261:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 4/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:0.0:1781281098.185305:0:14261:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef140304 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083794368:192.168.202.40@tcp:104: 00000100:00100000:0.0:1781281098.185337:0:14261:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bd54e48e going to sleep for 43 seconds 00010000:00010000:2.0:1781281098.185371:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1781281098.185376:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185384:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000058c50850 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185388:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185400:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185420:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 1/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185426:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c50850/0xce40b48e7cd2271e lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185443:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1781281098.185445:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185450:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003111fe9e already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185452:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185457:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185466:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 1/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185482:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003111fe9e/0xce40b48e7cd22725 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185496:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1781281098.185498:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185504:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008c473751 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185506:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185512:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 3/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185521:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 1/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185527:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c473751/0xce40b48e7cd22709 lrc: 0/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185538:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1781281098.185559:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185566:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb50e5d2 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185568:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185573:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185582:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 1/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185592:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb50e5d2/0xce40b48e7cd22741 lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185603:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1781281098.185605:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185610:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e3f7809 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185611:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185616:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185624:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 1/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185629:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3f7809/0xce40b48e7cd2274f lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185639:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1781281098.185642:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 2/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185646:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005276f645 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185648:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 2/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185657:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 3/0,0 mode: PW/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185664:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 1/0,0 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185670:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005276f645/0xce40b48e7cd22748 lrc: 0/0,0 mode: --/PW res: [0xde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185680:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1781281098.185683:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185688:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fe691eef already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185691:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185696:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185704:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 1/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185709:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe691eef/0xce40b48e7cd22733 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185720:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1781281098.185722:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185727:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000944b7559 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185729:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185733:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185741:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 1/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185747:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944b7559/0xce40b48e7cd2273a lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185764:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1781281098.185767:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185772:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000069b7952d already unused, calling callback (000000001cc3c1c2) 00010000:00010000:2.0:1781281098.185773:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185779:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185787:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 1/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185797:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b7952d/0xce40b48e7cd22702 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.185820:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.185822:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281098.185823:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281098.185873:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a135e866 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083792576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41166us (41788us total) trans 4294968363 rc 0/0 00000100:00100000:2.0:1781281098.185881:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:0.0:1781281098.185917:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000004:00080000:1.0:1781281098.190980:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b3002a04/2, rc 0, transno 1071 00000100:00100000:1.0:1781281098.191007:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3002a04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083793152:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1781281098.191021:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000003a90157d/2, rc 0, transno 1069 00000100:00100000:1.0:1781281098.191024:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a90157d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083792448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281098.191039:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1781281098.191050:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096c12348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.191108:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.193332:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794112 00000100:00100000:3.0:1781281098.193413:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:3.0:1781281098.193420:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e444468c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3175:x1867808083794048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.193454:0:7755:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:444 count 1 00010000:00010000:3.0:1781281098.193516:0:7755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193556:0:7755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 2/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 13 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193565:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193567:0:7755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193569:0:7755:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 4/0,1 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193608:0:7755:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 3/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 13 pid: 14278 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193619:0:7755:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 4/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 13 pid: 14278 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.193632:0:7755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083794432:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.193710:0:7755:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c5ebc285 going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.193737:0:14266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:3.0:1781281098.193742:0:14266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f102fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3175:x1867808083794304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.193757:0:14266:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:280 count 1 00010000:00010000:3.0:1781281098.193769:0:14266:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193780:0:14266:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193785:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193786:0:14266:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193787:0:14266:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 4/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193804:0:14266:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193811:0:14266:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.193820:0:14266:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd4f939a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083794496:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.193843:0:14266:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eaa4b62f going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.193859:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:3.0:1781281098.193864:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+70:3177:x1867808083794112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1781281098.193875:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:443 count 1 00010000:00010000:3.0:1781281098.193885:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193896:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 13 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193901:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193902:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1781281098.193904:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 4/0,1 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193920:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 3/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 13 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.193938:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 4/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 13 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.193946:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083794560:192.168.202.40@tcp:104: 00000100:00100000:3.0:1781281098.193969:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dbe7142c going to sleep for 43 seconds 00000100:00100000:3.0:1781281098.193996:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813184 00010000:00010000:3.0:1781281098.194016:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 4/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 14 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.194047:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4912 00000100:00100000:3.0:1781281098.194052:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+14:2271:x1867808064813184:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.194061:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.194067:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 4/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 14 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.194078:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 3/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 14 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.194105:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be371f6/0xce40b48e7ccff901 lrc: 0/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff2c9 expref: 14 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.194120:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.194121:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.194125:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194137:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 4/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194177:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.194202:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2271:x1867808064813184:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 150us (8287us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.194210:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4912 00010000:00010000:3.0:1781281098.194240:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194248:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194256:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,1 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194262:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194278:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.194609:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad065030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3175:x1867808083793856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28020us (28104us total) trans 4294968120 rc 0/0 00000100:00100000:3.0:1781281098.194616:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00010000:00010000:3.0:1781281098.194635:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.194640:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194652:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f4615c42 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.194655:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 2/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194662:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 3/0,0 mode: PW/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194674:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 1/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194680:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4615c42/0xce40b48e7cd22756 lrc: 0/0,0 mode: --/PW res: [0xe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.194696:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.194698:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.194700:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1781281098.194736:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000078020e9d/2, rc 0, transno 824 00000100:00100000:3.0:1781281098.194750:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078020e9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083793856:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.194766:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c847f2ef/2, rc 0, transno 1067 00000100:00100000:3.0:1781281098.194771:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c847f2ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083792576:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1781281098.194843:0:14261:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef140304 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14261:1867808083794368:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.194862:0:14261:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.194993:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.195053:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813248 00010000:00010000:3.0:1781281098.195068:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 4/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.195090:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4913 00000100:00100000:3.0:1781281098.195095:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2271:x1867808064813248:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1781281098.195104:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.195107:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 4/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.195115:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 3/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.195128:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009757dace/0xce40b48e7ccff6e6 lrc: 0/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff1e2 expref: 13 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.195138:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.195139:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.195141:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195148:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 4/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195165:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.195191:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c24606bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064813248:12345-192.168.202.40@tcp:103:ldlm_bl_03.0 Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.195198:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4913 00010000:00010000:3.0:1781281098.195214:0:14261:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195221:0:14261:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195228:0:14261:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,1 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195234:0:14261:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195246:0:14261:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.195399:0:14261:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000306d8604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3175:x1867808083794240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10224us (10394us total) trans 4294968121 rc 0/0 00000100:00100000:3.0:1781281098.195406:0:14261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00010000:00010000:3.0:1781281098.195421:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.195424:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195430:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053486f83 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.195432:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 2/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195439:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 3/0,0 mode: PW/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195449:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 1/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195455:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053486f83/0xce40b48e7cd22764 lrc: 0/0,0 mode: --/PW res: [0xe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195468:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.195483:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.195484:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1781281098.195505:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009d43769d/2, rc 0, transno 825 00000100:00100000:3.0:1781281098.195510:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d43769d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794240:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1781281098.195588:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195595:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195601:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195606:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195617:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1781281098.195623:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.195625:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195629:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087ec9154 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.195631:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195636:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195646:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 1/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195650:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ec9154/0xce40b48e7cd2275d lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.195673:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.195674:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.195675:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.196038:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9db967c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3178:x1867808083793792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29155us (29203us total) trans 4294968122 rc 0/0 00000100:00100000:3.0:1781281098.196046:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00010000:00010000:3.0:1781281098.196071:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.196088:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f1e1dd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083794688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.200612:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.202127:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281098.202133:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.202159:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794176 00000100:00100000:1.0:1781281098.202193:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794688 00000100:00100000:0.0:1781281098.202203:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.202316:0:7755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7755:1867808083794432:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.202341:0:7755:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.202390:0:14266:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd4f939a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14266:1867808083794496:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.202400:0:14266:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.202449:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15268:1867808083794560:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281098.202461:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.202503:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.202524:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281098.202557:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813376 00010000:00010000:3.0:1781281098.202579:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 12 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.202600:0:6141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813312 00010000:00010000:3.0:1781281098.202609:0:6141:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 4/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 13 pid: 14278 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.202628:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4914 00000100:00100000:3.0:1781281098.202634:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2271:x1867808064813376:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.202648:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.202653:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202663:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202687:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b751b7a/0xce40b48e7cd029d0 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c00625 expref: 13 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202707:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.202710:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.202713:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202722:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 4/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202744:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.202792:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000143d3b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064813376:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 157us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.202800:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4914 00000100:00100000:3.0:1781281098.202816:0:6141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4915 00000100:00100000:3.0:1781281098.202821:0:6141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+11:2271:x1867808064813312:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.202829:0:6141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.202832:0:6141:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 4/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 11 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202842:0:6141:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 3/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 11 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202855:0:6141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e40e6cc/0xce40b48e7cd20b8e lrc: 0/0,0 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a5ea expref: 11 pid: 14278 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.202864:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.202865:0:6141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.202868:0:6141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202874:0:6141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 4/0,1 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202890:0:6141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.202908:0:6141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4f939a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a285b906-59a1-4d21-bb2d-09007a70ac15+10:2271:x1867808064813312:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 86us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.202914:0:6141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4915 00010000:00010000:3.0:1781281098.202938:0:14266:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202946:0:14266:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202955:0:14266:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202961:0:14266:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.202977:0:14266:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.203255:0:14266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f102fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:3175:x1867808083794304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9511us (18172us total) trans 4294968123 rc 0/0 00000100:00100000:3.0:1781281098.203263:0:14266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:1.0:1781281098.203375:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794624 00000100:00100000:1.0:1781281098.203407:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:1.0:1781281098.203411:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3177:x1867808083794176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.203433:0:7752:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:227 count 1 00010000:00010000:1.0:1781281098.203454:0:7752:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203468:0:7752:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 9 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203486:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203487:0:7752:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203489:0:7752:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 4/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203515:0:7752:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 9 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203524:0:7752:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 9 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.203536:0:7752:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083794752:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.203590:0:7752:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062b75efb going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.203605:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:1.0:1781281098.203610:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+73:3178:x1867808083794688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.203622:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:223 count 1 00010000:00010000:1.0:1781281098.203633:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203644:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 9 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203650:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203651:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203652:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 4/0,1 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203697:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 9 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203705:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 9 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.203714:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f2a7da4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083794816:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.203736:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 00000000be409de1 going to sleep for 43 seconds 00000100:00100000:1.0:1781281098.203754:0:14226:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:1.0:1781281098.203758:0:14226:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084537aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3177:x1867808083794624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1781281098.203772:0:14226:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:279 count 1 00010000:00010000:1.0:1781281098.203783:0:14226:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203793:0:14226:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 9 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203799:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203800:0:14226:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281098.203801:0:14226:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 4/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203816:0:14226:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 9 pid: 7754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.203822:0:14226:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 9 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:1.0:1781281098.203830:0:14226:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046218474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083794880:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281098.203850:0:14226:0:(client.c:2500:ptlrpc_set_wait()) set 00000000438be9e4 going to sleep for 43 seconds 00000004:00080000:1.0:1781281098.203875:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002819e6c8/2, rc 0, transno 826 00000100:00100000:1.0:1781281098.203888:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002819e6c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793792:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1781281098.203900:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008600bb97/2, rc 0, transno 820 00000100:00100000:1.0:1781281098.203903:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008600bb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1781281098.203914:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000004ac67cd/2, rc 0, transno 1070 00000100:00100000:1.0:1781281098.203922:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004ac67cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083793280:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1781281098.209653:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1781281098.209665:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209687:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033bbad87 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:3.0:1781281098.209690:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209699:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209724:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 1/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209730:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bbad87/0xce40b48e7cd22772 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209762:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.209764:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.209765:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781281098.209778:0:7755:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209786:0:7755:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209794:0:7755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,1 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209800:0:7755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 2/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.209843:0:7755:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281098.210161:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e444468c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3175:x1867808083794048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16739us (25106us total) trans 4294968124 rc 0/0 00000100:00100000:3.0:1781281098.210171:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000004:00080000:3.0:1781281098.210229:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a6398534/2, rc 0, transno 828 00000100:00100000:3.0:1781281098.210250:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6398534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794048:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1781281098.210263:0:3175:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b36b7248/2, rc 0, transno 827 00000100:00100000:3.0:1781281098.210266:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b36b7248 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083794304:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.210319:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.210323:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 2/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.210331:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002ddb8830 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.210333:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 2/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.210340:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 3/0,0 mode: PW/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.210352:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 1/0,0 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.210358:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddb8830/0xce40b48e7cd2276b lrc: 0/0,0 mode: --/PW res: [0x1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781281098.210370:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1781281098.210372:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.210373:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.210374:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.210495:0:9361:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813440 00010000:00010000:3.0:1781281098.210521:0:9361:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 4/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 10 pid: 14248 timeout: 720 lvb_type: 0 00000100:00100000:3.0:1781281098.210577:0:9361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4916 00000100:00100000:3.0:1781281098.210583:0:9361:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+10:2271:x1867808064813440:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1781281098.210876:0:9361:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1781281098.210881:0:9361:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 4/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 10 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.210893:0:9361:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 3/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 10 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.210910:0:9361:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d7b9e3/0xce40b48e7cd2080e lrc: 0/0,0 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a4d2 expref: 10 pid: 14248 timeout: 720 lvb_type: 0 00010000:00010000:3.0:1781281098.210927:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.210929:0:9361:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1781281098.210932:0:9361:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.210941:0:9361:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 4/0,1 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281098.210970:0:9361:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1781281098.211009:0:9361:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8f9516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+9:2271:x1867808064813440:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 426us (640us total) trans 0 rc 0/0 00010000:00010000:1.0:1781281098.211115:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.211124:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.211136:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,1 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.211142:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.211157:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.211339:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068983bef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+74:3177:x1867808083794112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17473us (26096us total) trans 4294968125 rc 0/0 00000100:00100000:1.0:1781281098.211347:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000004:00080000:1.0:1781281098.211382:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000c51624ad/2, rc 0, transno 829 00000100:00100000:1.0:1781281098.211391:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c51624ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1781281098.213284:0:7752:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091d788d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7752:1867808083794752:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.213318:0:7752:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.213414:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f2a7da4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083794816:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.213425:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.213448:0:14226:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046218474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14226:1867808083794880:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281098.213458:0:14226:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213648:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281098.213653:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213662:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000065be7b9a already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281098.213665:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 2/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213673:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 3/0,0 mode: PW/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213693:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 1/0,0 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213700:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065be7b9a/0xce40b48e7cd22779 lrc: 0/0,0 mode: --/PW res: [0x1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.213720:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.213721:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.213722:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.214852:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.214887:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281098.214959:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281098.215403:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813504 00010000:00010000:2.0:1781281098.215438:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 10 pid: 7755 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.215480:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813632 00010000:00010000:2.0:1781281098.215491:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 11 pid: 7754 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.215505:0:6142:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813568 00010000:00010000:2.0:1781281098.215512:0:6142:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 12 pid: 14266 timeout: 720 lvb_type: 0 00000100:00100000:2.0:1781281098.215527:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4917 00000100:00100000:2.0:1781281098.215533:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b74607c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064813504:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.215568:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.215572:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 4/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 12 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215588:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 12 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215608:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a52f8ec/0xce40b48e7ccff7b8 lrc: 0/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bff23d expref: 12 pid: 7755 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215623:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215625:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215629:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215637:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 4/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215661:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.215704:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b74607c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+11:2271:x1867808064813504:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 171us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.215712:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4917 00000100:00100000:2.0:1781281098.215728:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4918 00000100:00100000:2.0:1781281098.215731:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046218474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+10:2271:x1867808064813632:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.215738:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.215741:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 10 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215748:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 10 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215786:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a28dc47/0xce40b48e7cd028f0 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472c005ca expref: 10 pid: 7754 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215797:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215798:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215800:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215805:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 4/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215820:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.215838:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046218474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+9:2271:x1867808064813632:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 106us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.215845:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4918 00000100:00100000:2.0:1781281098.215857:0:6142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4919 00000100:00100000:2.0:1781281098.215861:0:6142:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f2a7da4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+8:2271:x1867808064813568:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1781281098.215869:0:6142:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1781281098.215872:0:6142:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x60000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215880:0:6142:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x50000400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215891:0:6142:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed372a54/0xce40b48e7ccfecd6 lrc: 0/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x44801400030020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfee93 expref: 8 pid: 14266 timeout: 720 lvb_type: 0 00010000:00010000:2.0:1781281098.215904:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215906:0:6142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1781281098.215909:0:6142:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215914:0:6142:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 4/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281098.215928:0:6142:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1781281098.215945:0:6142:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f2a7da4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a285b906-59a1-4d21-bb2d-09007a70ac15+7:2271:x1867808064813568:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 83us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.215951:0:6142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4919 00010000:00010000:1.0:1781281098.216019:0:7752:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216028:0:7752:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216037:0:7752:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,1 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216044:0:7752:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216070:0:7752:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281098.216362:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052409705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3177:x1867808083794176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12949us (25254us total) trans 4294968126 rc 0/0 00000100:00100000:1.0:1781281098.216369:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00010000:00010000:1.0:1781281098.216393:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216401:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216407:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216412:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216423:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1781281098.216593:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000398b4a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+74:3178:x1867808083794688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12982us (14473us total) trans 4294968127 rc 0/0 00000100:00100000:1.0:1781281098.216600:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00010000:00010000:1.0:1781281098.216714:0:14226:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216723:0:14226:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216730:0:14226:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216735:0:14226:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281098.216748:0:14226:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1781281098.216831:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000096c12348/2, rc 0, transno 830 00000100:00100000:0.0:1781281098.216844:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096c12348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794176:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.216863:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1781281098.216867:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281098.216871:0:14226:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084537aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3177:x1867808083794624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13112us (14668us total) trans 4294968128 rc 0/0 00010000:00010000:0.0:1781281098.216874:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d80d7073 already unused, calling callback (000000001cc3c1c2) 00000100:00100000:1.0:1781281098.216877:0:14226:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00010000:00010000:0.0:1781281098.216877:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 2/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216885:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 3/0,0 mode: PW/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216898:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 1/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216908:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80d7073/0xce40b48e7cd22780 lrc: 0/0,0 mode: --/PW res: [0xe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7752 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216921:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1781281098.216923:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216928:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba10c2d7 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.216929:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216934:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216941:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 1/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216946:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba10c2d7/0xce40b48e7cd22787 lrc: 0/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216955:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1781281098.216957:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216961:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da730b65 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:0.0:1781281098.216963:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216972:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216980:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 1/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781281098.216985:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da730b65/0xce40b48e7cd2278e lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1781281098.216989:0:3178:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000002f1e1dd4/2, rc 0, transno 831 00010000:00010000:0.0:1781281098.216995:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281098.216996:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f1e1dd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083794688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1781281098.216996:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281098.216997:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281098.217009:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1781281098.217026:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a7a01549/2, rc 0, transno 832 00000100:00100000:0.0:1781281098.217042:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7a01549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083794624:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1781281098.217383:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781281098.220991:0:9361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4916 00000001:00080000:3.0:1781281098.396245:0:7780:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968116 is committed 00000001:00080000:3.0:1781281098.396447:0:7780:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968128 is committed 00000100:00100000:1.0:1781281098.831973:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1781281098.832000:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083794944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1781281098.832094:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.832427:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083794944 00000100:00100000:2.0:1781281098.832520:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1781281098.832529:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054164445 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083794944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1781281098.832586:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 251854848 pending 0 free 3805282304 avail 3803185152 00000100:00100000:2.0:1781281098.832628:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054164445 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083794944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281098.832635:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1781281098.832790:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083794944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1781281098.834945:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3175:1867808083795200:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835015:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835040:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083795456:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835143:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835222:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795712:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835244:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835264:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1781281098.835270:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47603186-6904-49ab-a5a2-ed3a7a058862:3175:1867808083795008:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835294:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835309:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c3ba4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795264:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835330:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835344:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b1addb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795520:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835363:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.835405:0:6149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795008 00000100:00100000:3.0:1781281098.835446:0:6149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1781281098.835452:0:6149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8025838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47603186-6904-49ab-a5a2-ed3a7a058862+23:3175:x1867808083795008:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835509:0:6149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8025838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47603186-6904-49ab-a5a2-ed3a7a058862+23:3175:x1867808083795008:12345-0@lo:400:kworker/u8:3.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.835517:0:6149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1781281098.835831:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c24606bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47603186-6904-49ab-a5a2-ed3a7a058862:3175:1867808083795008:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835871:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795264 00000100:00100000:3.0:1781281098.835895:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1781281098.835899:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089885e18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3175:x1867808083795264:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835934:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089885e18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3175:x1867808083795264:12345-0@lo:400:kworker/u8:3.0 Request processed in 34us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.835941:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1781281098.835963:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c3ba4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795264:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.835998:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3177:1867808083795072:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.836025:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.836039:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3177:1867808083795328:0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1781281098.836251:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795200 00000100:00100000:0.0:1781281098.836277:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795072 00000100:00100000:0.0:1781281098.836293:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1781281098.836296:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c5c7381 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3175:x1867808083795200:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1781281098.836333:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c5c7381 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3175:x1867808083795200:12345-0@lo:400:kworker/u8:3.0 Request processed in 36us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281098.836340:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1781281098.836354:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1781281098.836357:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d566d31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3177:x1867808083795072:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:0.0:1781281098.836382:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d566d31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3177:x1867808083795072:12345-0@lo:400:kworker/u8:3.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281098.836390:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00010000:00010000:0.0:1781281098.836408:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781281098.836425:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd8f9516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3175:1867808083795200:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.836739:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.836868:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd4f939a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083795136:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.836913:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3177:1867808083795584:0@lo:400:kworker/u8:3.0 00000004:00080000:2.0:1781281098.837023:0:9053:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 621541480402ns, next at 622541478269ns, rc = 0 00000100:00100000:2.0:1781281098.837056:0:3175:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1781281098.837065:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1781281098.837122:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795328 00000100:00100000:0.0:1781281098.837156:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1781281098.837162:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cd28084 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3177:x1867808083795328:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.838490:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.838628:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281098.838679:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000143d3b1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3177:1867808083795072:0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.838730:0:6161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795136 00000100:00100000:3.0:1781281098.838782:0:6161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1781281098.838787:0:6161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d6c024a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083795136:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.838832:0:6161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d6c024a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083795136:12345-0@lo:400:kworker/u8:3.0 Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.838838:0:6161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1781281098.838893:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795456 00000100:00100000:3.0:1781281098.838918:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795712 00000100:00100000:3.0:1781281098.838934:0:7752:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795520 00000100:00100000:3.0:1781281098.838950:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1781281098.838953:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6965cce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083795456:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.838985:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6965cce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083795456:12345-0@lo:400:kworker/u8:3.0 Request processed in 31us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.838991:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1781281098.839002:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1781281098.839005:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015da3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083795712:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.839031:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015da3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083795712:12345-0@lo:400:kworker/u8:3.0 Request processed in 25us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.839036:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1781281098.839253:0:7752:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1781281098.839258:0:7752:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1786cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3175:x1867808083795520:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.839288:0:7752:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1786cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3175:x1867808083795520:12345-0@lo:400:kworker/u8:3.0 Request processed in 30us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.839294:0:7752:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1781281098.839447:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795584 00000100:00100000:3.0:1781281098.839484:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1781281098.839488:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095b241ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3177:x1867808083795584:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:3.0:1781281098.839526:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095b241ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3177:x1867808083795584:12345-0@lo:400:kworker/u8:3.0 Request processed in 37us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.839642:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1781281098.839824:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c9fe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3177:1867808083795584:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.839951:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd4f939a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083795136:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.839964:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3178:1867808083795392:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.839998:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.840025:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065fc3517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3178:1867808083795648:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.840129:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281098.840237:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795392 00000100:00100000:1.0:1781281098.840265:0:6155:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795648 00000100:00100000:1.0:1781281098.840280:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1781281098.840285:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003aa4cd74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3178:x1867808083795392:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.840321:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003aa4cd74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3178:x1867808083795392:12345-0@lo:400:kworker/u8:3.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.840327:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1781281098.840337:0:6155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1781281098.840341:0:6155:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000510ca9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3178:x1867808083795648:12345-0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281098.840365:0:6155:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000510ca9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3178:x1867808083795648:12345-0@lo:400:kworker/u8:3.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281098.840370:0:6155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00010000:00080000:1.0:1781281098.840397:0:3178:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000f255ffed x1867808083795392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281142 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:3.0' 00000100:00100000:1.0:1781281098.840407:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f255ffed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3178:1867808083795392:0@lo:400:kworker/u8:3.0 00010000:00080000:1.0:1781281098.840415:0:3178:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@0000000065fc3517 x1867808083795648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281142 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:3.0' 00000100:00100000:1.0:1781281098.840421:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065fc3517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3178:1867808083795648:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1781281098.840981:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281098.841016:0:3175:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968128 gen 2 00000004:00080000:2.0:1781281098.841020:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000062097c0, transno 4294968060 00000004:00080000:2.0:1781281098.841035:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000065093734, transno 4294968061 00000004:00080000:2.0:1781281098.841037:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000024d058b5, transno 4294968062 00000004:00080000:2.0:1781281098.841040:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b7e79b84, transno 4294968063 00000100:00100000:3.0:1781281098.841126:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795776 00000100:00100000:3.0:1781281098.841165:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1781281098.841169:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026ffe626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083795776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1781281098.841187:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 251854848 pending 0 free 3805282304 avail 3803185152 00000100:00100000:3.0:1781281098.841222:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026ffe626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+69:3175:x1867808083795776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281098.841228:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000004:00080000:2.0:1781281098.841660:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000affb6812, transno 4294968064 00000004:00080000:2.0:1781281098.841666:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b0664d22, transno 4294968065 00000004:00080000:2.0:1781281098.841668:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d3dbdb4c, transno 4294968066 00000004:00080000:2.0:1781281098.841670:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d27c9c17, transno 4294968067 00000004:00080000:2.0:1781281098.841672:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000df937771, transno 4294968068 00000004:00080000:2.0:1781281098.841674:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c5058fa8, transno 4294968069 00000004:00080000:2.0:1781281098.841676:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a56045fb, transno 4294968070 00000004:00080000:2.0:1781281098.841678:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000499d901d, transno 4294968071 00000004:00080000:2.0:1781281098.841680:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009896e16a, transno 4294968072 00000004:00080000:2.0:1781281098.841682:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004a93075c, transno 4294968073 00000004:00080000:2.0:1781281098.841684:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009f4c6dbc, transno 4294968074 00000004:00080000:2.0:1781281098.841686:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000157bb568, transno 4294968075 00000004:00080000:2.0:1781281098.841688:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000e403ae05, transno 4294968076 00000004:00080000:2.0:1781281098.841689:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000da99ed28, transno 4294968077 00000004:00080000:2.0:1781281098.841691:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c996d9a0, transno 4294968078 00000004:00080000:2.0:1781281098.841693:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000001e84bfa2, transno 4294968079 00000004:00080000:2.0:1781281098.841696:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000286b2351, transno 4294968080 00000004:00080000:2.0:1781281098.841698:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000012516b00, transno 4294968081 00000004:00080000:2.0:1781281098.841700:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000076b417da, transno 4294968082 00000004:00080000:2.0:1781281098.841702:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000cb275633, transno 4294968083 00000004:00080000:2.0:1781281098.841704:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000093681051, transno 4294968084 00000004:00080000:2.0:1781281098.841706:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000001b348c11, transno 4294968085 00000004:00080000:2.0:1781281098.841708:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c23147e4, transno 4294968086 00000004:00080000:2.0:1781281098.841710:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009b8d9e3b, transno 4294968087 00000004:00080000:2.0:1781281098.841713:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000be368255, transno 4294968088 00000004:00080000:2.0:1781281098.841715:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000fc51e6f7, transno 4294968089 00000004:00080000:2.0:1781281098.841717:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000321b98a1, transno 4294968090 00000004:00080000:2.0:1781281098.841719:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000040bd1c69, transno 4294968091 00000004:00080000:2.0:1781281098.841721:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b301ab65, transno 4294968092 00000004:00080000:2.0:1781281098.841723:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000537e5100, transno 4294968093 00000004:00080000:2.0:1781281098.841725:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000006ea28b72, transno 4294968094 00000004:00080000:2.0:1781281098.841727:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000003bbef9f3, transno 4294968095 00000004:00080000:2.0:1781281098.841730:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000008503c74, transno 4294968096 00000004:00080000:2.0:1781281098.841732:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000089d1bb22, transno 4294968097 00000004:00080000:2.0:1781281098.841734:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000cab17534, transno 4294968098 00000004:00080000:2.0:1781281098.841736:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008ab95811, transno 4294968099 00000004:00080000:2.0:1781281098.841739:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d1cc9db9, transno 4294968100 00000004:00080000:2.0:1781281098.841742:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b0c44b46, transno 4294968101 00000004:00080000:2.0:1781281098.841744:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000dd10e6de, transno 4294968102 00000004:00080000:2.0:1781281098.841746:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b1b9ba9f, transno 4294968103 00000004:00080000:2.0:1781281098.841748:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000006743c856, transno 4294968104 00000004:00080000:2.0:1781281098.841761:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000011fa024f, transno 4294968105 00000004:00080000:2.0:1781281098.841764:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d648dc00, transno 4294968106 00000004:00080000:2.0:1781281098.841766:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009d6b34d8, transno 4294968107 00000004:00080000:2.0:1781281098.841768:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c6ce960b, transno 4294968108 00000004:00080000:2.0:1781281098.841770:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000063deab88, transno 4294968109 00000004:00080000:2.0:1781281098.841772:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000058cda886, transno 4294968110 00000004:00080000:2.0:1781281098.841774:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d5dc0226, transno 4294968111 00000004:00080000:2.0:1781281098.841776:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a2d5e1ef, transno 4294968112 00000004:00080000:2.0:1781281098.841778:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002252d9c7, transno 4294968113 00000004:00080000:2.0:1781281098.841780:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000dab1fc84, transno 4294968114 00000004:00080000:2.0:1781281098.841783:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000502f1435, transno 4294968115 00000004:00080000:2.0:1781281098.841785:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008600bb97, transno 4294968116 00000004:00080000:2.0:1781281098.841787:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004818406c, transno 4294968117 00000004:00080000:2.0:1781281098.841789:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f80346c6, transno 4294968118 00000004:00080000:2.0:1781281098.841791:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000063ad18a3, transno 4294968119 00000004:00080000:2.0:1781281098.841793:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000078020e9d, transno 4294968120 00000004:00080000:2.0:1781281098.841796:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009d43769d, transno 4294968121 00000004:00080000:2.0:1781281098.841798:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002819e6c8, transno 4294968122 00000004:00080000:2.0:1781281098.841800:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b36b7248, transno 4294968123 00000004:00080000:2.0:1781281098.841803:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a6398534, transno 4294968124 00000004:00080000:2.0:1781281098.841806:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c51624ad, transno 4294968125 00000004:00080000:2.0:1781281098.841807:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000096c12348, transno 4294968126 00000004:00080000:2.0:1781281098.841809:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002f1e1dd4, transno 4294968127 00000004:00080000:2.0:1781281098.841812:0:3175:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a7a01549, transno 4294968128 00000100:00100000:2.0:1781281098.841818:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b1addb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795520:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1781281098.841838:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb22516f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083795456:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1781281098.841850:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a16d7521 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795712:0@lo:400:kworker/u8:3.0 00000100:00100000:2.0:1781281098.841883:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3175:1867808083795776:0@lo:13:osp-pre-1-0.0 00000040:00100000:1.0:1781281098.842412:0:8123:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 69 records, first 446 in log [0x3:0x1:0x0] 00000004:00080000:1.0:1781281098.842635:0:8123:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 0 in progress, 0 in flight, 69 done 00000100:00100000:0.0:1781281098.847987:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cd28084 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3177:x1867808083795328:12345-0@lo:400:kworker/u8:3.0 Request processed in 10814us (11239us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281098.848004:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1781281098.849703:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec4734e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3177:1867808083795328:0@lo:400:kworker/u8:3.0 00000100:00100000:1.0:1781281099.347113:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1781281099.347152:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083795840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1781281099.347223:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281099.347374:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795840 00000100:00100000:2.0:1781281099.347425:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1781281099.347430:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002025b790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083795840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1781281099.347472:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1781281099.347520:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002025b790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083795840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281099.347527:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1781281099.347641:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083795840:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1781281099.429561:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968365 is committed 00000001:00080000:2.0:1781281099.429689:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968367 is committed 00000100:00100000:2.0:1781281099.857251:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1781281099.857272:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006151247b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083795904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1781281099.857336:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281099.857382:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795904 00000100:00100000:2.0:1781281099.857419:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1781281099.857425:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e51931ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3177:x1867808083795904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1781281099.857476:0:8307:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:2.0:1781281099.857516:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e51931ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3177:x1867808083795904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281099.857523:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1781281099.857584:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006151247b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083795904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1781281099.858608:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0047ea3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083795968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1781281099.858662:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281099.858795:0:6161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083795968 00000100:00100000:1.0:1781281099.858835:0:6161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1781281099.858840:0:6161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083795968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1781281099.858876:0:6161:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2259419136 avail 2257321984 00000100:00100000:1.0:1781281099.858918:0:6161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b3da1ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083795968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281099.858925:0:6161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1781281099.858959:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0047ea3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083795968:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1781281099.859157:0:8124:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622563614404ns, next at 623563612283ns, rc = 0 00000100:00100000:3.0:1781281099.859176:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c3cab2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1781281099.859205:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281099.859309:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796032 00000100:00100000:1.0:1781281099.859341:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1781281099.859345:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000de772b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3176:x1867808083796032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1781281099.859359:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1781281099.859398:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000de772b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3176:x1867808083796032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281099.859404:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1781281099.859482:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c3cab2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1781281099.862072:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281099.978120:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281099.978183:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281099.978410:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813888 00000100:00100000:3.0:1781281099.978483:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 258 00000100:00100000:3.0:1781281099.978490:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044ed7bae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+6:2271:x1867808064813888:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281099.978598:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044ed7bae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+6:2271:x1867808064813888:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281099.978606:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 258 00000100:00100000:1.0:1781281099.978831:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281099.979181:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281099.979231:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281099.979264:0:8137:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813952 00000100:00100000:1.0:1781281099.979290:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:1.0:1781281099.979296:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af9cd4f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+7:2271:x1867808064813952:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781281099.979333:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af9cd4f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+7:2271:x1867808064813952:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281099.979340:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:0.0:1781281099.979573:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813760 00000100:00100000:0.0:1781281099.979611:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813824 00000100:00100000:0.0:1781281099.979629:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 552 00000100:00100000:0.0:1781281099.979634:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0047ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064813760:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781281099.979671:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0047ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+12:2271:x1867808064813760:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 37us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281099.979696:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 552 00000100:00100000:0.0:1781281099.979710:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 553 00000100:00100000:0.0:1781281099.979714:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001694aa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2271:x1867808064813824:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781281099.979750:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001694aa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2271:x1867808064813824:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 23us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281099.979759:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 553 00000100:00100000:2.0:1781281099.985444:0:6151:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064813696 00000100:00100000:2.0:1781281099.985610:0:6151:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 406 00000100:00100000:2.0:1781281099.985617:0:6151:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ea462cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2a3cfb9-b70e-4511-9147-a4b2837abe9f+9:2271:x1867808064813696:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781281099.985720:0:6151:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ea462cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2a3cfb9-b70e-4511-9147-a4b2837abe9f+9:2271:x1867808064813696:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 102us (6889us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281099.985727:0:6151:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 406 00010000:00010000:2.0:1781281100.879819:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781281101.903764:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281102.692827:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.693002:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814080 00000100:00100000:2.0:1781281102.693071:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16794 00000100:00100000:2.0:1781281102.693078:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b3147a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+12:12581:x1867808064814080:12345-192.168.202.40@tcp:101:diff.0 00010000:00010000:2.0:1781281102.693099:0:6158:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1781281102.693119:0:6158:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fe691eef/0xce40b48e7cd22795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a8a6 expref: -99 pid: 6158 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1781281102.693244:0:6158:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1db:0x0]: returning size 11264 00010000:00010000:2.0:1781281102.693467:0:6158:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000fe691eef/0xce40b48e7cd22795 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8a6 expref: 14 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281102.693477:0:6158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fe691eef/0xce40b48e7cd22795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8a6 expref: 14 pid: 6158 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281102.693490:0:6158:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fe691eef, rc 0) 00000100:00100000:2.0:1781281102.693607:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b3147a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12581:x1867808064814080:12345-192.168.202.40@tcp:101:diff.0 Request processed in 529us (790us total) trans 4294975699 rc 301/301 00000100:00100000:2.0:1781281102.693616:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16794 00000100:00100000:1.0:1781281102.698973:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.699276:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814144 00000100:00100000:2.0:1781281102.699334:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4828 00000100:00100000:2.0:1781281102.699341:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015aabbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12581:x1867808064814144:12345-192.168.202.40@tcp:37:diff.0 00000100:00100000:2.0:1781281102.713266:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015aabbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12581:x1867808064814144:12345-192.168.202.40@tcp:37:diff.0 Request processed in 13917us (14293us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.713283:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4828 00000100:00100000:1.0:1781281102.717002:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.717528:0:12447:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814272 00000100:00100000:2.0:1781281102.717620:0:12447:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4829 00000100:00100000:2.0:1781281102.717627:0:12447:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c44924 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12581:x1867808064814272:12345-192.168.202.40@tcp:35:diff.0 00000100:00100000:2.0:1781281102.718328:0:12447:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c44924 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+14:12581:x1867808064814272:12345-192.168.202.40@tcp:35:diff.0 Request processed in 699us (1334us total) trans 4294975700 rc 0/0 00000100:00100000:2.0:1781281102.718338:0:12447:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4829 00000100:00100000:1.0:1781281102.723501:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.729301:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814336 00000100:00100000:3.0:1781281102.729388:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16795 00000100:00100000:3.0:1781281102.729395:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cad305cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+14:12581:x1867808064814336:12345-192.168.202.40@tcp:101:diff.0 00010000:00010000:3.0:1781281102.729422:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281102.729454:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7cd227a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a8ad expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.729515:0:14242:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000087ec9154/0xce40b48e7cd227aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.729530:0:14242:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087ec9154/0xce40b48e7cd227aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.729560:0:14242:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087ec9154/0xce40b48e7cd227aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281102.733239:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1de:0x0]: returning size 11264 00000004:00200000:3.0:1781281102.733251:0:14242:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1781281102.733295:0:14242:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000087ec9154/0xce40b48e7cd227aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.733343:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7cd227a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8ad expref: 16 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.733367:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000087ec9154/0xce40b48e7cd227aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1de:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8ad expref: 15 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.733375:0:14242:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1de:0x0].0x0 (000000002ad3475c) 00010000:00010000:3.0:1781281102.733377:0:14242:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1781281102.733381:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087ec9154, rc 0) 00000100:00100000:3.0:1781281102.733782:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cad305cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+15:12581:x1867808064814336:12345-192.168.202.40@tcp:101:diff.0 Request processed in 4385us (10287us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.733798:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16795 00000100:00100000:1.0:1781281102.740900:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.741032:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814464 00000100:00100000:3.0:1781281102.741089:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16796 00000100:00100000:3.0:1781281102.741095:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb2577d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+15:12581:x1867808064814464:12345-192.168.202.40@tcp:101:diff.0 00010000:00010000:3.0:1781281102.741115:0:14242:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1781281102.741135:0:14242:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7cd227b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd38fa41472c0a8b4 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1781281102.741248:0:14242:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1de:0x0]: returning size 11264 00010000:00010000:3.0:1781281102.741364:0:14242:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7cd227b1 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8b4 expref: 17 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.741385:0:14242:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033bbad87/0xce40b48e7cd227b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472c0a8b4 expref: 17 pid: 14242 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281102.741396:0:14242:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033bbad87, rc 0) 00000100:00100000:3.0:1781281102.741465:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb2577d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+16:12581:x1867808064814464:12345-192.168.202.40@tcp:101:diff.0 Request processed in 369us (574us total) trans 4294975701 rc 301/301 00000100:00100000:3.0:1781281102.741473:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16796 00000100:00100000:0.0:1781281102.748174:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.748395:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814528 00000100:00100000:2.0:1781281102.748460:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4830 00000100:00100000:2.0:1781281102.748467:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+16:12581:x1867808064814528:12345-192.168.202.40@tcp:37:diff.0 00000100:00100000:2.0:1781281102.756520:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a82acc9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+16:12581:x1867808064814528:12345-192.168.202.40@tcp:37:diff.0 Request processed in 8043us (8341us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.756537:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4830 00000100:00100000:1.0:1781281102.760340:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.761059:0:15253:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814656 00000100:00100000:2.0:1781281102.761119:0:15253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4831 00000100:00100000:2.0:1781281102.761126:0:15253:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004460cc6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+16:12581:x1867808064814656:12345-192.168.202.40@tcp:35:diff.0 00000100:00100000:2.0:1781281102.762146:0:15253:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004460cc6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12581:x1867808064814656:12345-192.168.202.40@tcp:35:diff.0 Request processed in 1016us (1810us total) trans 4294975702 rc 0/0 00000100:00100000:2.0:1781281102.762157:0:15253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4831 00000100:00100000:0.0:1781281102.805930:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.806039:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814720 00000100:00100000:2.0:1781281102.806094:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16797 00000100:00100000:2.0:1781281102.806101:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814720:12345-192.168.202.40@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1781281102.806273:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d20f691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814720:12345-192.168.202.40@tcp:501:chlg_load_threa.0 Request processed in 171us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.806282:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16797 00000100:00100000:0.0:1781281102.819796:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.820087:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814784 00000100:00100000:2.0:1781281102.820147:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16798 00000100:00100000:2.0:1781281102.820153:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814784:12345-192.168.202.40@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1781281102.820404:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef66bec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814784:12345-192.168.202.40@tcp:503:chlg_load_threa.0 Request processed in 250us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.820414:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16798 00000100:00100000:1.0:1781281102.830352:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.830584:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814848 00000100:00100000:3.0:1781281102.830642:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16799 00000100:00100000:3.0:1781281102.830649:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070eec7dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814848:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.830898:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070eec7dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814848:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 247us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.830906:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16799 00000100:00100000:0.0:1781281102.833774:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.833929:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814912 00000100:00100000:2.0:1781281102.833989:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16800 00000100:00100000:2.0:1781281102.833995:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814912:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281102.834230:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b09184b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814912:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 233us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.834238:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16800 00000100:00100000:0.0:1781281102.836598:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.837001:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064814976 00000100:00100000:3.0:1781281102.837060:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16801 00000100:00100000:3.0:1781281102.837067:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814976:12345-192.168.202.40@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1781281102.837169:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ee28bd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064814976:12345-192.168.202.40@tcp:501:chlg_load_threa.0 Request processed in 101us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.837177:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16801 00000100:00100000:1.0:1781281102.839020:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.839832:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815040 00000100:00100000:3.0:1781281102.839888:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16802 00000100:00100000:3.0:1781281102.839894:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012f79675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815040:12345-192.168.202.40@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1781281102.840076:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012f79675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815040:12345-192.168.202.40@tcp:503:chlg_load_threa.0 Request processed in 180us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.840084:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16802 00000100:00100000:0.0:1781281102.843134:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.843359:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815104 00000100:00100000:1.0:1781281102.843420:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16803 00000100:00100000:1.0:1781281102.843436:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815104:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.843666:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4dc3b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815104:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 240us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.843674:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16803 00000100:00100000:0.0:1781281102.848736:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.848853:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815168 00000100:00100000:3.0:1781281102.848908:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16804 00000100:00100000:3.0:1781281102.848914:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0a01c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815168:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.849138:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0a01c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815168:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 223us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.849147:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16804 00000100:00100000:0.0:1781281102.853517:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.854179:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815232 00000100:00100000:1.0:1781281102.854240:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16805 00000100:00100000:1.0:1781281102.854247:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815232:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.854694:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a11e9fc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815232:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 446us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.854703:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16805 00000100:00100000:0.0:1781281102.862226:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.862332:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815296 00000100:00100000:3.0:1781281102.862386:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16806 00000100:00100000:3.0:1781281102.862392:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815296:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.862634:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037147d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815296:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 241us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.862642:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16806 00000100:00100000:0.0:1781281102.865183:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.865371:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815360 00000100:00100000:1.0:1781281102.865440:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16807 00000100:00100000:1.0:1781281102.865447:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef140304 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815360:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.865654:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef140304 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815360:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 206us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.865662:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16807 00000100:00100000:0.0:1781281102.871440:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.878247:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815424 00000100:00100000:3.0:1781281102.878320:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16808 00000100:00100000:3.0:1781281102.878328:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815424:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.879300:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad82cf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815424:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 968us (7874us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.879313:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16808 00000100:00100000:0.0:1781281102.885568:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.885683:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815488 00000100:00100000:3.0:1781281102.885748:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16809 00000100:00100000:3.0:1781281102.885755:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815488:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.886089:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d72280d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815488:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 273us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.886098:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16809 00000100:00100000:0.0:1781281102.889989:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.890218:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815552 00000100:00100000:1.0:1781281102.890320:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16810 00000100:00100000:1.0:1781281102.890327:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815552:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.890568:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d286027f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815552:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 240us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.890577:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16810 00000100:00100000:0.0:1781281102.897436:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.897718:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815616 00000100:00100000:1.0:1781281102.897774:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16811 00000100:00100000:1.0:1781281102.897788:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815616:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.897979:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db06a9c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815616:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 198us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.897988:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16811 00000100:00100000:0.0:1781281102.905226:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.905389:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815680 00000100:00100000:1.0:1781281102.905452:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16812 00000100:00100000:1.0:1781281102.905458:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815680:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.905666:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ea053f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815680:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 208us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.905675:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16812 00000100:00100000:0.0:1781281102.913675:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.913810:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815744 00000100:00100000:2.0:1781281102.913862:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16813 00000100:00100000:2.0:1781281102.913869:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815744:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281102.914073:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075f4167c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815744:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.914081:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16813 00000100:00100000:0.0:1781281102.917653:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.919529:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815808 00000100:00100000:2.0:1781281102.919625:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16814 00000100:00100000:2.0:1781281102.919632:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815808:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281102.919840:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7677f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815808:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 208us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.919849:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16814 00010000:00010000:2.0:1781281102.928243:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281102.932094:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.932335:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815872 00000100:00100000:1.0:1781281102.932383:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16815 00000100:00100000:1.0:1781281102.932389:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1eb7c0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815872:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.932606:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1eb7c0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815872:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 216us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.932615:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16815 00000100:00100000:1.0:1781281102.934850:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.934886:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064815936 00000100:00100000:1.0:1781281102.934923:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16816 00000100:00100000:1.0:1781281102.934929:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a06df402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815936:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.935084:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a06df402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064815936:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 154us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.935092:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16816 00000100:00100000:1.0:1781281102.943632:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.943903:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816000 00000100:00100000:3.0:1781281102.943966:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16817 00000100:00100000:3.0:1781281102.943974:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097817224 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816000:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.944206:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097817224 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816000:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 232us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.944214:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16817 00000100:00100000:1.0:1781281102.948389:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.950073:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816064 00000100:00100000:3.0:1781281102.950126:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16818 00000100:00100000:3.0:1781281102.950133:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000049e561 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816064:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.950333:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000049e561 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816064:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 199us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.950341:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16818 00000100:00100000:2.0:1781281102.966244:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.966307:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816128 00000100:00100000:3.0:1781281102.966356:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16819 00000100:00100000:3.0:1781281102.966363:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006151247b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816128:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.966589:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006151247b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816128:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 224us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.966598:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16819 00000100:00100000:1.0:1781281102.969837:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281102.975808:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816192 00000100:00100000:1.0:1781281102.975872:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16820 00000100:00100000:1.0:1781281102.975880:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020dda891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816192:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281102.976077:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020dda891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816192:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 197us (6248us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281102.976086:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16820 00000100:00100000:0.0:1781281102.979176:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.979423:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816256 00000100:00100000:3.0:1781281102.979570:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16821 00000100:00100000:3.0:1781281102.979579:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816256:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.979799:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c793319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816256:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 220us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.979808:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16821 00000100:00100000:2.0:1781281102.990640:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281102.990703:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816320 00000100:00100000:3.0:1781281102.990769:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16822 00000100:00100000:3.0:1781281102.990776:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddfbfddb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816320:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281102.991005:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddfbfddb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816320:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 227us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281102.991015:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16822 00000100:00100000:1.0:1781281102.994684:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281102.995229:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816384 00000100:00100000:2.0:1781281102.995299:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16823 00000100:00100000:2.0:1781281102.995306:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a86a4729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816384:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281102.995524:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a86a4729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816384:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 216us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281102.995532:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16823 00000100:00100000:1.0:1781281103.004027:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281103.005762:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816448 00000100:00100000:3.0:1781281103.005863:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16824 00000100:00100000:3.0:1781281103.005873:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088b361cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816448:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281103.006130:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088b361cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816448:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 258us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281103.006138:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16824 00000100:00100000:0.0:1781281103.010780:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.010873:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816512 00000100:00100000:1.0:1781281103.010929:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16825 00000100:00100000:1.0:1781281103.010935:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816512:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.011153:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eebb80f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816512:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 217us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.011161:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16825 00000100:00100000:1.0:1781281103.017506:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.017823:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816576 00000100:00100000:2.0:1781281103.017872:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16826 00000100:00100000:2.0:1781281103.017879:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c95b95b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816576:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.018105:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c95b95b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+17:12583:x1867808064816576:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 226us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.018115:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16826 00000001:00080000:0.0:1781281103.020088:0:6178:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975702 is committed 00000004:00080000:0.0:1781281103.020104:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000004:00080000:0.0:1781281103.020130:0:6178:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00000100:00100000:1.0:1781281103.020333:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015aabbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083796096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281103.020399:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.020442:0:3177:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1781281103.020448:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5657e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083796160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1781281103.020471:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.020513:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796096 00000100:00100000:1.0:1781281103.020562:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796160 00000100:00100000:1.0:1781281103.020573:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1781281103.020577:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000499d901d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3177:x1867808083796096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281103.020599:0:15268:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:223 count 1 00010000:00010000:1.0:1781281103.020623:0:15268:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020639:0:15268:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 6 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020645:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281103.020647:0:15268:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281103.020649:0:15268:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 4/0,1 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020669:0:15268:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 6 pid: 14266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020678:0:15268:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 6 pid: 14266 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1781281103.020686:0:15268:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083796224:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281103.020726:0:15268:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b0051f16 going to sleep for 6 seconds 00000100:00100000:1.0:1781281103.020737:0:8137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1781281103.020740:0:8137:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009896e16a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3177:x1867808083796160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1781281103.020749:0:8137:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:224 count 1 00010000:00010000:1.0:1781281103.020756:0:8137:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020763:0:8137:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020767:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281103.020768:0:8137:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1781281103.020769:0:8137:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 4/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020778:0:8137:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.020782:0:8137:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1781281103.020788:0:8137:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f2ddc48 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083796288:192.168.202.40@tcp:104: 00000100:00100000:1.0:1781281103.020802:0:8137:0:(client.c:2500:ptlrpc_set_wait()) set 0000000039f5d647 going to sleep for 6 seconds 00000100:00100000:1.0:1781281103.020879:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.020962:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816640 00000100:00100000:1.0:1781281103.021001:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16827 00000100:00100000:1.0:1781281103.021004:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816640:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.021169:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002ae6699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816640:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.021176:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16827 00000100:00100000:2.0:1781281103.021329:0:3176:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1781281103.021340:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9402741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1781281103.021370:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281103.021398:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796352 00000100:00100000:2.0:1781281103.021422:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:2.0:1781281103.021437:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097b8bbc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3176:x1867808083796352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1781281103.021450:0:14276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:224 count 1 00010000:00010000:2.0:1781281103.021470:0:14276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281103.021483:0:14276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 5 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281103.021489:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281103.021490:0:14276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1781281103.021492:0:14276:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 4/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281103.021512:0:14276:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 5 pid: 7755 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781281103.021519:0:14276:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 5 pid: 7755 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1781281103.021528:0:14276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069d9f4e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083796416:192.168.202.40@tcp:104: 00000100:00100000:2.0:1781281103.021576:0:14276:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000162f93 going to sleep for 43 seconds 00000100:00100000:1.0:1781281103.032463:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.032655:0:14276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069d9f4e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14276:1867808083796416:192.168.202.40@tcp:104: 00010000:00010000:1.0:1781281103.032681:0:14276:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781281103.032827:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816704 00000100:00100000:2.0:1781281103.032879:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16828 00000100:00100000:2.0:1781281103.032885:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816704:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.033105:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083830b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816704:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 219us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.033115:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16828 00000100:00100000:0.0:1781281103.033780:0:8137:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f2ddc48 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8137:1867808083796288:192.168.202.40@tcp:104: 00010000:00010000:0.0:1781281103.033805:0:8137:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781281103.036976:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.037036:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.037113:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.037152:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816768 00010000:00010000:1.0:1781281103.037193:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 7 pid: 14266 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1781281103.037231:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816896 00010000:00010000:1.0:1781281103.037245:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1781281103.037265:0:6143:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816832 00010000:00010000:1.0:1781281103.037274:0:6143:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 8 pid: 7755 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1781281103.037296:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4920 00000100:00100000:1.0:1781281103.037302:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+8:2271:x1867808064816768:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281103.037317:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281103.037321:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 4/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 8 pid: 14266 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037333:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 8 pid: 14266 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037359:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008877d070/0xce40b48e7ccfef1b lrc: 0/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef50 expref: 8 pid: 14266 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037377:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037379:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037382:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037391:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 4/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037412:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281103.037494:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f2ddc48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+7:2271:x1867808064816768:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 191us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.037502:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4920 00000100:00100000:1.0:1781281103.037522:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4921 00000100:00100000:1.0:1781281103.037526:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e403ae05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+6:2271:x1867808064816896:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1781281103.037535:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281103.037538:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037589:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037603:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064d3fb04/0xce40b48e7ccfef76 lrc: 0/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef6c expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037612:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037613:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037615:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037621:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 4/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037639:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281103.037658:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e403ae05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2271:x1867808064816896:12345-192.168.202.40@tcp:103:ldlm_bl_04.0 Request processed in 131us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.037664:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4921 00000100:00100000:1.0:1781281103.037676:0:6143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4922 00000100:00100000:1.0:1781281103.037681:0:6143:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012516b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+6:2271:x1867808064816832:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1781281103.037688:0:6143:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1781281103.037691:0:6143:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 4/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037704:0:6143:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037724:0:6143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006112f1fe/0xce40b48e7ccfefd1 lrc: 0/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.202.40@tcp remote: 0xd38fa41472bfef88 expref: 6 pid: 7755 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1781281103.037733:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037734:0:6143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1781281103.037736:0:6143:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037742:0:6143:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 4/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037762:0:6143:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1781281103.037781:0:6143:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012516b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2271:x1867808064816832:12345-192.168.202.40@tcp:103:ldlm_bl_02.0 Request processed in 100us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.037787:0:6143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4922 00010000:00010000:1.0:1781281103.037820:0:8137:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037828:0:8137:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037837:0:8137:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037848:0:8137:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.037865:0:8137:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281103.038323:0:8137:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009896e16a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3177:x1867808083796160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17580us (17850us total) trans 4294968368 rc 0/0 00000100:00100000:1.0:1781281103.038331:0:8137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00010000:00010000:1.0:1781281103.038354:0:6144:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281103.038358:0:6144:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.038366:0:6144:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000da730b65 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281103.038369:0:6144:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.038376:0:6144:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.038388:0:6144:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 1/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.038394:0:6144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da730b65/0xce40b48e7cd227c6 lrc: 0/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8137 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.038408:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.038409:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.038410:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281103.038458:0:3177:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968367 gen 2 00000004:00080000:1.0:1781281103.038465:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000004f49510, transno 4294968304 00000004:00080000:1.0:1781281103.038474:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009dfc4c63, transno 4294968305 00000004:00080000:1.0:1781281103.038477:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000006ece1721, transno 4294968306 00000004:00080000:1.0:1781281103.038479:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f0d70729, transno 4294968307 00000004:00080000:1.0:1781281103.038480:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008f87dee6, transno 4294968308 00000004:00080000:1.0:1781281103.038482:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000012218d17, transno 4294968309 00000004:00080000:1.0:1781281103.038485:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000083d3ef0f, transno 4294968310 00000004:00080000:1.0:1781281103.038487:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008544c56b, transno 4294968311 00000004:00080000:1.0:1781281103.038489:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000007f1a637c, transno 4294968312 00000004:00080000:1.0:1781281103.038491:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000005b758d73, transno 4294968313 00000004:00080000:1.0:1781281103.038493:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c11f9572, transno 4294968314 00000004:00080000:1.0:1781281103.038495:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000006ec8ad43, transno 4294968315 00000004:00080000:1.0:1781281103.038497:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000418c7a9a, transno 4294968316 00000004:00080000:1.0:1781281103.038499:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000bdc966fd, transno 4294968317 00000004:00080000:1.0:1781281103.038501:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000017b45a95, transno 4294968318 00000004:00080000:1.0:1781281103.038503:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002fdd872e, transno 4294968319 00000004:00080000:1.0:1781281103.038505:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000068ffcb28, transno 4294968320 00000004:00080000:1.0:1781281103.038507:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000878e9aed, transno 4294968321 00000004:00080000:1.0:1781281103.038509:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009d572d1a, transno 4294968322 00000004:00080000:1.0:1781281103.038511:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009c7c8001, transno 4294968323 00000004:00080000:1.0:1781281103.038513:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000022f8bfc6, transno 4294968324 00000004:00080000:1.0:1781281103.038515:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004f191b70, transno 4294968325 00000004:00080000:1.0:1781281103.038518:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000ba0fbf7b, transno 4294968326 00000004:00080000:1.0:1781281103.038520:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b0d00831, transno 4294968327 00000004:00080000:1.0:1781281103.038522:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008362d394, transno 4294968328 00000004:00080000:1.0:1781281103.038524:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c4da86eb, transno 4294968329 00000004:00080000:1.0:1781281103.038525:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000398f68c1, transno 4294968330 00000004:00080000:1.0:1781281103.038528:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f0dfc8c3, transno 4294968331 00000004:00080000:1.0:1781281103.038530:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009dfb9b17, transno 4294968332 00000004:00080000:1.0:1781281103.038533:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002a0eccfa, transno 4294968333 00000004:00080000:1.0:1781281103.038535:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000e8b7e1a5, transno 4294968334 00000004:00080000:1.0:1781281103.038537:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000050e17a1, transno 4294968335 00000004:00080000:1.0:1781281103.038569:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f18c39a5, transno 4294968336 00000004:00080000:1.0:1781281103.038572:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000bb2284de, transno 4294968337 00000004:00080000:1.0:1781281103.038574:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f7ede5eb, transno 4294968338 00000004:00080000:1.0:1781281103.038576:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000003c251b58, transno 4294968339 00000004:00080000:1.0:1781281103.038578:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000001aa9f8c, transno 4294968340 00000004:00080000:1.0:1781281103.038580:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004ce2078b, transno 4294968341 00000004:00080000:1.0:1781281103.038582:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000f2c6e3e6, transno 4294968342 00000004:00080000:1.0:1781281103.038584:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000012a9343, transno 4294968343 00000004:00080000:1.0:1781281103.038586:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000030badc11, transno 4294968344 00000004:00080000:1.0:1781281103.038588:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004e8451f3, transno 4294968345 00000004:00080000:1.0:1781281103.038589:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000965a84c7, transno 4294968346 00000004:00080000:1.0:1781281103.038591:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000075ce134d, transno 4294968347 00000004:00080000:1.0:1781281103.038593:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008aea4e0e, transno 4294968348 00000004:00080000:1.0:1781281103.038595:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000005d5fdac3, transno 4294968349 00000004:00080000:1.0:1781281103.038597:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000000f12aa75, transno 4294968350 00000004:00080000:1.0:1781281103.038599:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000003d34b60a, transno 4294968351 00000004:00080000:1.0:1781281103.038601:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000001483d93, transno 4294968352 00000004:00080000:1.0:1781281103.038603:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000ca6451f8, transno 4294968353 00000004:00080000:1.0:1781281103.038605:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c7e3c20a, transno 4294968354 00000004:00080000:1.0:1781281103.038607:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a36bb8b8, transno 4294968355 00000004:00080000:1.0:1781281103.038609:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000945477a4, transno 4294968356 00000004:00080000:1.0:1781281103.038611:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000871c5db5, transno 4294968357 00000004:00080000:1.0:1781281103.038612:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000001eaef2af, transno 4294968358 00000004:00080000:1.0:1781281103.038615:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000006406b574, transno 4294968359 00000004:00080000:1.0:1781281103.038617:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000007d984b3b, transno 4294968360 00000004:00080000:1.0:1781281103.038619:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000da78fd71, transno 4294968361 00000004:00080000:1.0:1781281103.038621:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000074cc6eeb, transno 4294968362 00000004:00080000:1.0:1781281103.038624:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000c847f2ef, transno 4294968363 00000004:00080000:1.0:1781281103.038625:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000002ef69984, transno 4294968364 00000004:00080000:1.0:1781281103.038627:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000003a90157d, transno 4294968365 00000004:00080000:1.0:1781281103.038630:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000004ac67cd, transno 4294968366 00000004:00080000:1.0:1781281103.038632:0:3177:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000b3002a04, transno 4294968367 00000100:00100000:1.0:1781281103.038637:0:3177:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@000000007d5657e3 x1867808083796160/t4294968368(4294968368) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1781281147 ref 2 fl Rpc:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000004:00080000:1.0:1781281103.038648:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000007d5657e3/2, rc 0, transno 1072 00000100:00100000:1.0:1781281103.038653:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5657e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083796160:0@lo:6:osp-syn-1-0.0 00000040:00100000:1.0:1781281103.038939:0:9052:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 64 records, first 447 in log [0x6:0x1:0x0] 00000004:00080000:1.0:1781281103.039068:0:9052:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 64 done 00010000:00010000:1.0:1781281103.039086:0:14276:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039094:0:14276:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039102:0:14276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,1 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039108:0:14276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039129:0:14276:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1781281103.039466:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097b8bbc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3176:x1867808083796352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18027us (18095us total) trans 4294968129 rc 0/0 00000100:00100000:1.0:1781281103.039475:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00010000:00010000:1.0:1781281103.039500:0:6145:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281103.039504:0:6145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039511:0:6145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fe691eef already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281103.039514:0:6145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 2/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039522:0:6145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 3/0,0 mode: PW/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039536:0:6145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 1/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039573:0:6145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe691eef/0xce40b48e7cd227cd lrc: 0/0,0 mode: --/PW res: [0xe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.039590:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.039592:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.039593:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1781281103.039625:0:3176:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000a9402741/2, rc 0, transno 833 00000100:00100000:1.0:1781281103.039631:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9402741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1781281103.040587:0:15268:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002252d9c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15268:1867808083796224:192.168.202.40@tcp:104: 00010000:00010000:3.0:1781281103.040627:0:15268:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281103.040642:0:15268:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281103.040648:0:15268:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281103.040656:0:15268:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,1 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281103.040662:0:15268:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781281103.040690:0:15268:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1781281103.041087:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000499d901d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+7:3177:x1867808083796096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20506us (20686us total) trans 4294968369 rc 0/0 00000100:00100000:3.0:1781281103.041098:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000004:00080000:0.0:1781281103.041307:0:3177:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000015aabbc2/2, rc 0, transno 1073 00000100:00100000:0.0:1781281103.041314:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015aabbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083796096:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1781281103.041971:0:14245:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781281103.041978:0:14245:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.042064:0:14245:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000390a2f94 already unused, calling callback (000000001cc3c1c2) 00010000:00010000:1.0:1781281103.042068:0:14245:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 2/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.042083:0:14245:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 3/0,0 mode: PW/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.042166:0:14245:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 1/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.042173:0:14245:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000390a2f94/0xce40b48e7cd227bf lrc: 0/0,0 mode: --/PW res: [0xdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15268 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781281103.042196:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.042198:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781281103.042200:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281103.042414:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.042518:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064816960 00000100:00100000:1.0:1781281103.042676:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16829 00000100:00100000:1.0:1781281103.042683:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1223ad8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816960:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.042910:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1223ad8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064816960:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 226us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.042919:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16829 00000100:00100000:1.0:1781281103.047854:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.048408:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817024 00000100:00100000:2.0:1781281103.048477:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16830 00000100:00100000:2.0:1781281103.048484:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068ffcb28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817024:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.048743:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068ffcb28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817024:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 258us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.048752:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16830 00000100:00100000:3.0:1781281103.052055:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.052233:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817088 00000100:00100000:1.0:1781281103.052295:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16831 00000100:00100000:1.0:1781281103.052304:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817088:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.052591:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9313bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817088:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 287us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.052601:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16831 00000100:00100000:0.0:1781281103.058782:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.059505:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817152 00000100:00100000:2.0:1781281103.059592:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16832 00000100:00100000:2.0:1781281103.059599:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817152:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.059833:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088443b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817152:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 233us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.059842:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16832 00000100:00100000:3.0:1781281103.070874:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.070976:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817216 00000100:00100000:1.0:1781281103.071057:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16833 00000100:00100000:1.0:1781281103.071065:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d16d0357 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817216:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.071447:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d16d0357 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817216:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 381us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.071456:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16833 00000100:00100000:2.0:1781281103.077382:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.077537:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817280 00000100:00100000:1.0:1781281103.077654:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16834 00000100:00100000:1.0:1781281103.077661:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d903b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817280:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.077883:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d903b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817280:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 221us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.077892:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16834 00000100:00100000:0.0:1781281103.082464:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.082582:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817344 00000100:00100000:2.0:1781281103.082623:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16835 00000100:00100000:2.0:1781281103.082628:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c24d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817344:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.082821:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c24d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817344:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 190us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.082830:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16835 00000100:00100000:3.0:1781281103.086685:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.086931:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817408 00000100:00100000:1.0:1781281103.087003:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16836 00000100:00100000:1.0:1781281103.087010:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4fdc14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817408:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.087227:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4fdc14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817408:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 204us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.087237:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16836 00000100:00100000:3.0:1781281103.089920:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.090031:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817472 00000100:00100000:2.0:1781281103.090092:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16837 00000100:00100000:2.0:1781281103.090099:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ef0eb31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817472:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.090511:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ef0eb31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817472:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 411us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.090520:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16837 00000100:00100000:0.0:1781281103.096326:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.096643:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817536 00000100:00100000:1.0:1781281103.096702:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16838 00000100:00100000:1.0:1781281103.096717:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817536:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.096924:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004617c2eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817536:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 215us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.096933:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16838 00000100:00100000:3.0:1781281103.099650:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.103171:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817600 00000100:00100000:2.0:1781281103.103358:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16839 00000100:00100000:2.0:1781281103.103366:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faf33150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817600:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.103607:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faf33150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817600:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 241us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.103616:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16839 00000100:00100000:3.0:1781281103.112106:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.112354:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817664 00000100:00100000:2.0:1781281103.112420:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16840 00000100:00100000:2.0:1781281103.112436:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817664:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.113026:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e90a136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817664:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 588us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.113035:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16840 00000100:00100000:0.0:1781281103.115106:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.115230:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817728 00000100:00100000:2.0:1781281103.115279:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16841 00000100:00100000:2.0:1781281103.115284:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817728:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.115474:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c920cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817728:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 189us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.115484:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16841 00000100:00100000:3.0:1781281103.121959:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.122272:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817792 00000100:00100000:1.0:1781281103.122330:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16842 00000100:00100000:1.0:1781281103.122337:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000845cd941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817792:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.122601:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000845cd941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817792:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 262us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.122609:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16842 00000100:00100000:3.0:1781281103.125597:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.125755:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817856 00000100:00100000:2.0:1781281103.125815:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16843 00000100:00100000:2.0:1781281103.125822:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7ede5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817856:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.126042:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7ede5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817856:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 220us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.126050:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16843 00000100:00100000:0.0:1781281103.128263:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.133143:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817920 00000100:00100000:1.0:1781281103.133214:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16844 00000100:00100000:1.0:1781281103.133221:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009dfb9b17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817920:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.133456:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009dfb9b17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817920:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 233us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.133464:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16844 00000100:00100000:0.0:1781281103.135674:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.135790:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064817984 00000100:00100000:2.0:1781281103.135842:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16845 00000100:00100000:2.0:1781281103.135849:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000050e17a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817984:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.136041:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000050e17a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064817984:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 191us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.136049:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16845 00000100:00100000:3.0:1781281103.138098:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.138315:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818048 00000100:00100000:1.0:1781281103.138376:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16846 00000100:00100000:1.0:1781281103.138382:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c251b58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818048:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.138632:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c251b58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818048:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 248us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.138652:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16846 00000100:00100000:0.0:1781281103.141524:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.141797:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818112 00000100:00100000:2.0:1781281103.141872:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16847 00000100:00100000:2.0:1781281103.141879:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818112:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.142071:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2012912 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818112:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 191us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.142080:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16847 00000100:00100000:0.0:1781281103.150156:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.150347:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818176 00000100:00100000:2.0:1781281103.150403:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16848 00000100:00100000:2.0:1781281103.150410:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000286b2351 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818176:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.151113:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000286b2351 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818176:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 699us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.151123:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16848 00000100:00100000:3.0:1781281103.167011:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.167151:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818240 00000100:00100000:2.0:1781281103.167332:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16849 00000100:00100000:2.0:1781281103.167340:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001aa9f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818240:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1781281103.167669:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001aa9f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818240:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 326us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.167678:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16849 00000100:00100000:0.0:1781281103.182206:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281103.186981:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818304 00000100:00100000:3.0:1781281103.187589:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16850 00000100:00100000:3.0:1781281103.187598:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1d9319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818304:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281103.187825:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1d9319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818304:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 227us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281103.187832:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16850 00000100:00100000:0.0:1781281103.191315:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.191494:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818368 00000100:00100000:1.0:1781281103.191597:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16851 00000100:00100000:1.0:1781281103.191604:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be3ca0df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818368:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.191809:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be3ca0df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818368:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 204us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.191817:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16851 00000100:00100000:2.0:1781281103.200783:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281103.201268:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818432 00000100:00100000:3.0:1781281103.201324:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16852 00000100:00100000:3.0:1781281103.201331:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e08383a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818432:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281103.201586:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e08383a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818432:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 254us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281103.201594:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16852 00000100:00100000:0.0:1781281103.204142:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.204486:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818496 00000100:00100000:1.0:1781281103.204571:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16853 00000100:00100000:1.0:1781281103.204578:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b00f37b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818496:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.204780:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b00f37b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818496:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 202us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.204788:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16853 00000100:00100000:0.0:1781281103.208539:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281103.209594:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818560 00000100:00100000:3.0:1781281103.209660:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16854 00000100:00100000:3.0:1781281103.209668:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2eebe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818560:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1781281103.210528:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2eebe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818560:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 856us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281103.210538:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16854 00000100:00100000:2.0:1781281103.222746:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281103.222850:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818624 00000100:00100000:0.0:1781281103.222919:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16855 00000100:00100000:0.0:1781281103.222927:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061c32095 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818624:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281103.223432:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061c32095 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818624:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 496us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.223441:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16855 00000100:00100000:2.0:1781281103.226744:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1781281103.226893:0:6158:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818688 00000100:00100000:1.0:1781281103.226954:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16856 00000100:00100000:1.0:1781281103.226960:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007c526d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818688:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1781281103.227178:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007c526d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818688:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 216us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.227186:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16856 00000100:00100000:3.0:1781281103.230198:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281103.230371:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818752 00000100:00100000:0.0:1781281103.230440:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16857 00000100:00100000:0.0:1781281103.230447:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ce2078b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818752:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281103.230710:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ce2078b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818752:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 262us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.230720:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16857 00000100:00100000:2.0:1781281103.235782:0:3168:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281103.236235:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818816 00000100:00100000:0.0:1781281103.236297:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16858 00000100:00100000:0.0:1781281103.236304:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e71357ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818816:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281103.236525:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e71357ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818816:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 220us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.236534:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16858 00000100:00100000:2.0:1781281103.243970:0:3170:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1781281103.244299:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818880 00000100:00100000:0.0:1781281103.244399:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16859 00000100:00100000:0.0:1781281103.244406:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009dc9f114 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818880:12345-192.168.202.40@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1781281103.244642:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009dc9f114 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a285b906-59a1-4d21-bb2d-09007a70ac15+13:12583:x1867808064818880:12345-192.168.202.40@tcp:502:chlg_load_threa.0 Request processed in 235us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.244651:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16859 00000001:00080000:0.0:1781281103.528064:0:7780:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968129 is committed 00000100:00100000:1.0:1781281103.952487:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009cac7a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1781281103.952615:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.952704:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796480 00000100:00100000:1.0:1781281103.952762:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1781281103.952769:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000878e9aed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3176:x1867808083796480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1781281103.952820:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 251854848 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1781281103.952864:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000878e9aed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3176:x1867808083796480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.952873:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1781281103.952903:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000502f1435 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3176:1867808083796736:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.952905:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069d9f4e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3178:1867808083796608:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1781281103.952939:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281103.952963:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4993208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083796992:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.952977:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.952992:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b479ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3178:1867808083796864:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1781281103.952993:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281103.953006:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f04d9420 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083797248:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.953014:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281103.953023:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.953026:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e997fce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3178:1867808083797120:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.953131:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083796672:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1781281103.953188:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009cac7a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083796480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1781281103.953229:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796992 00000100:00100000:2.0:1781281103.953264:0:14276:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797248 00000100:00100000:2.0:1781281103.953284:0:14276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1781281103.953288:0:14276:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bdc966fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083796992:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1781281103.953499:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1781281103.953504:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017b45a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083797248:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.957063:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.957154:0:3178:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1781281103.957665:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3002a04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47603186-6904-49ab-a5a2-ed3a7a058862:3178:1867808083796544:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.957743:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281103.957757:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796736 00000100:00100000:1.0:1781281103.957776:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083796800:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.957802:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.957822:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a135e866 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083797056:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.957829:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796608 00000100:00100000:0.0:1781281103.957848:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796864 00000100:00100000:1.0:1781281103.957849:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1781281103.957861:0:15255:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797120 00000100:00100000:1.0:1781281103.957875:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ec8ad43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083797312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1781281103.957876:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1781281103.957883:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418c7a9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3176:x1867808083796736:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.957900:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.957935:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1781281103.957940:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8b7e1a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3178:x1867808083796608:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.957959:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418c7a9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3176:x1867808083796736:12345-0@lo:400:kworker/u8:1.0 Request processed in 75us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.957968:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1781281103.957974:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8b7e1a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3178:x1867808083796608:12345-0@lo:400:kworker/u8:1.0 Request processed in 35us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.957979:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1781281103.957990:0:6158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1781281103.957993:0:6158:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f18c39a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3178:x1867808083796864:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.957998:0:15255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1781281103.958001:0:15255:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c6e3e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3178:x1867808083797120:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958018:0:6158:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f18c39a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3178:x1867808083796864:12345-0@lo:400:kworker/u8:1.0 Request processed in 23us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.958022:0:15255:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c6e3e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3178:x1867808083797120:12345-0@lo:400:kworker/u8:1.0 Request processed in 21us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.958023:0:6158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1781281103.958028:0:15255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1781281103.958045:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796800 00000100:00100000:1.0:1781281103.958073:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1781281103.958076:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008aea4e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083796800:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958107:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008aea4e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083796800:12345-0@lo:400:kworker/u8:1.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.958113:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1781281103.958113:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.958126:0:8307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796672 00000100:00100000:0.0:1781281103.958130:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eabab400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3175:1867808083796928:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958137:0:8307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1781281103.958140:0:8307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083796672:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958155:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281103.958167:0:8307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065093734 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083796672:12345-0@lo:400:kworker/u8:1.0 Request processed in 26us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.958173:0:8297:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796928 00000100:00100000:0.0:1781281103.958197:0:8297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1781281103.958202:0:8297:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3175:x1867808083796928:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958234:0:8297:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024d058b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3175:x1867808083796928:12345-0@lo:400:kworker/u8:1.0 Request processed in 32us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.958240:0:8297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1781281103.958257:0:8307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1781281103.958257:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23188b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3175:1867808083797184:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958281:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1781281103.958290:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781281103.958305:0:6157:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797184 00000100:00100000:0.0:1781281103.958322:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001123baba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083796672:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958324:0:6157:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1781281103.958327:0:6157:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e79b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3175:x1867808083797184:12345-0@lo:400:kworker/u8:1.0 00010000:00080000:0.0:1781281103.958336:0:3175:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000eabab400 x1867808083796928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281147 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1781281103.958347:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eabab400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3175:1867808083796928:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958355:0:6157:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e79b84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3175:x1867808083797184:12345-0@lo:400:kworker/u8:1.0 Request processed in 27us (74us total) trans 0 rc 0/0 00010000:00080000:0.0:1781281103.958355:0:3175:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000a23188b9 x1867808083797184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1781281147 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1781281103.958361:0:6157:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1781281103.958363:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23188b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3175:1867808083797184:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1781281103.958387:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797312 00000100:00100000:1.0:1781281103.958410:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1781281103.958425:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093681051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3178:x1867808083797312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1781281103.958442:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb290b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083796800:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958457:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069d9f4e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3178:1867808083796608:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958469:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b479ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3178:1867808083796864:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958479:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e997fce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3178:1867808083797120:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958578:0:7755:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797056 00000100:00100000:0.0:1781281103.958606:0:7755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1781281103.958610:0:7755:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076b417da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083797056:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.958645:0:7755:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076b417da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3178:x1867808083797056:12345-0@lo:400:kworker/u8:1.0 Request processed in 33us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.958652:0:7755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1781281103.959006:0:3178:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968129 gen 2 00000004:00080000:0.0:1781281103.959014:0:3178:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000a9402741, transno 4294968129 00000100:00100000:0.0:1781281103.959028:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a135e866 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3178:1867808083797056:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.959072:0:6151:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083796544 00000100:00100000:0.0:1781281103.959098:0:6151:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1781281103.959101:0:6151:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5b4adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47603186-6904-49ab-a5a2-ed3a7a058862+23:3178:x1867808083796544:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.959139:0:6151:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5b4adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47603186-6904-49ab-a5a2-ed3a7a058862+23:3178:x1867808083796544:12345-0@lo:400:kworker/u8:1.0 Request processed in 37us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1781281103.959146:0:6151:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1781281103.959196:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000502f1435 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3176:1867808083796736:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.959219:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3002a04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47603186-6904-49ab-a5a2-ed3a7a058862:3178:1867808083796544:0@lo:400:kworker/u8:1.0 00000040:00100000:0.0:1781281103.959260:0:8123:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 448 in log [0x3:0x1:0x0] 00002000:00000024:1.0:1781281103.959264:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 23855104 granted 251854848 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1781281103.959308:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093681051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3178:x1867808083797312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 893us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281103.959315:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1781281103.959355:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ec8ad43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083797312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1781281103.965863:0:14276:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bdc966fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083796992:12345-0@lo:400:kworker/u8:1.0 Request processed in 12561us (12857us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281103.965887:0:14276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1781281103.966115:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017b45a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3176:x1867808083797248:12345-0@lo:400:kworker/u8:1.0 Request processed in 12608us (13089us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281103.966129:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1781281103.966440:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4993208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083796992:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1781281103.966460:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f04d9420 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3176:1867808083797248:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1781281104.472366:0:3178:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083797376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1781281104.472456:0:3178:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281104.472519:0:7757:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797376 00000100:00100000:2.0:1781281104.472582:0:7757:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1781281104.472589:0:7757:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d572d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083797376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1781281104.472624:0:7757:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1781281104.472665:0:7757:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d572d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3178:x1867808083797376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281104.472672:0:7757:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1781281104.472716:0:3178:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3178:1867808083797376:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1781281104.552913:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968368 is committed 00000001:00080000:2.0:1781281104.552934:0:8586:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968369 is committed 00000100:00100000:1.0:1781281104.982211:0:3175:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b348c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083797440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1781281104.982280:0:3175:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1781281104.982341:0:6161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797440 00000100:00100000:1.0:1781281104.982386:0:6161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1781281104.982392:0:6161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c23147e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083797440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1781281104.982451:0:6161:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2259419136 avail 2257321984 00000100:00100000:1.0:1781281104.982493:0:6161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c23147e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3175:x1867808083797440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1781281104.982500:0:6161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1781281104.982578:0:3175:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b348c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3175:1867808083797440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1781281104.984830:0:6145:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781281104.988566:0:3176:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083797504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1781281104.988639:0:3176:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1781281104.988704:0:7756:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797504 00000100:00100000:2.0:1781281104.988745:0:7756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1781281104.988751:0:7756:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022f8bfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3176:x1867808083797504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1781281104.988775:0:7756:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 40894464 granted 135987200 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1781281104.988816:0:7756:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022f8bfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3176:x1867808083797504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281104.988823:0:7756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1781281104.988873:0:3176:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd872e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3176:1867808083797504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1781281104.990252:0:3177:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083797568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1781281104.990319:0:3177:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1781281104.990385:0:6162:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808083797568 00000100:00100000:3.0:1781281104.990440:0:6162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1781281104.990446:0:6162:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fdd872e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3177:x1867808083797568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1781281104.990485:0:6162:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:3.0:1781281104.994929:0:6162:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fdd872e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3177:x1867808083797568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4474us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281104.994947:0:6162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1781281104.997783:0:3177:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030badc11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3177:1867808083797568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1781281105.100252:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281105.100304:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281105.100331:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281105.100350:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1781281105.100354:0:6149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064818944 00000100:00100000:3.0:1781281105.100377:0:3169:0:(events.c:361:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1781281105.100402:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064819072 00000100:00100000:2.0:1781281105.100416:0:6149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:2.0:1781281105.100423:0:6149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fe0b45b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2a3cfb9-b70e-4511-9147-a4b2837abe9f+9:2270:x1867808064818944:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281105.100456:0:14242:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064819008 00000100:00100000:3.0:1781281105.100473:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 560 00000100:00100000:3.0:1781281105.100477:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c3cab2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819072:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281105.100505:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c3cab2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819072:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1781281105.100506:0:6149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fe0b45b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2a3cfb9-b70e-4511-9147-a4b2837abe9f+9:2270:x1867808064818944:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281105.100513:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 560 00000100:00100000:2.0:1781281105.100513:0:6149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:3.0:1781281105.100528:0:14242:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 561 00000100:00100000:3.0:1781281105.100531:0:14242:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008503c74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2270:x1867808064819008:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281105.100577:0:14242:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008503c74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a285b906-59a1-4d21-bb2d-09007a70ac15+13:2270:x1867808064819008:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281105.100583:0:14242:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 561 00000100:00100000:3.0:1781281105.100603:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064819200 00000100:00100000:3.0:1781281105.100630:0:15268:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867808064819136 00000100:00100000:3.0:1781281105.100648:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 263 00000100:00100000:3.0:1781281105.100652:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bbef9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819200:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281105.100684:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bbef9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819200:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281105.100690:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 263 00000100:00100000:3.0:1781281105.100702:0:15268:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 264 00000100:00100000:3.0:1781281105.100706:0:15268:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cab17534 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819136:12345-192.168.202.40@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781281105.100729:0:15268:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cab17534 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:a285b906-59a1-4d21-bb2d-09007a70ac15+5:2270:x1867808064819136:12345-192.168.202.40@tcp:400:kworker/u8:1.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1781281105.100734:0:15268:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 264 00000400:00000080:0.0:1781281105.540878:0:15331:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1781281105.540885:0:15331:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: lustre-rsync-test test_2c: @@@@@@ FAIL: Failure in replication; differences found. 00010000:00010000:1.0:1781281106.000162:0:14245:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781281107.025524:0:6144:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 24226 lines, 24226 kept, 0 dropped, 0 bad.